Loss Landscape: Why Skip Connections Matter

Li et al., "Visualizing the Loss Landscape of Neural Nets" (NeurIPS 2018) — arXiv:1712.09913

Visualizes a 2D filter-normalized slice of the high-dimensional loss surface, following Li et al. 2018. Ball trajectories illustrate curvature, not literal training dynamics.

ResNet-56 — CIFAR-10
Loading surface…
Final loss distribution