paper-with-me

홈 › Papers

Loss Landscape Geometry and the Learning of Symmetries: Or, What Influence Functions Reveal About Robust Generalization

2026-01-28 · James Amarel, Robyn Miller, Nicolas Hengartner, Benjamin Migliori, Emily Casleton, Alexei Skurikhin, Earl Lawrence, Gerd J. Kunde arxiv

We study how neural emulators of partial differential equation solution operators internalize physical symmetries by introducing an influence-based diagnostic that measures the propagation of parameter updates between symmetry-related states, defined as the metric-weighted overlap of loss gradients evaluated along group orbits. This quantity probes the local geometry of the learned loss landscape and goes beyond forward-pass equivariance tests by directly assessing whether learning dynamics couple physically equivalent configurations. Applying our diagnostic to autoregressive fluid flow emulators, we show that orbit-wise gradient coherence provides the mechanism for learning to generalize over symmetry transformations and indicates when training selects a symmetry compatible basin. The result is a novel technique for evaluating if surrogate models have internalized symmetry properties of the known solution operator.

📄 PDF Abstract BibTeX arXiv:2601.20172

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

FuNNscope: Visual microscope for interactively exploring the loss landscape of fully connected neural networks

2022-04-09 · Aleksandar Doknic, Torsten Möller

Despite their effective use in various fields, many aspects of neural networks are poorly understood. One important way to investigate the characteristics of neural networks is to explore the loss landscape. However, mos…

The Role of Symmetry in Optimizing Overparameterized Networks

2026-04-28 · Kusha Sareen, Mohammad Pedramfar, Sékou-Oumar Kaba, Mehran Shakerinava 외 arxiv

Overparameterization is central to the success of deep learning, yet the mechanisms by which it improves optimization remain incompletely understood. We analyze weight-space symmetries in neural networks and show that ov…

Explaining Near-Zero Hessian Eigenvalues Through Approximate Symmetries in Neural Networks

2026-07-08 · Marcel Kühn, Bernd Rosenow arxiv

The Hessian of the training loss governs the local geometry of the loss landscape, yet despite existing explanations for its largest eigenvalues, the origin of the vast multitude of vanishingly small eigenvalues remains …

The loss surface of deep linear networks viewed through the algebraic geometry lens

2018-10-17 · Dhagash Mehta, Tianran Chen, Tingting Tang, Jonathan D. Hauenstein

By using the viewpoint of modern computational algebraic geometry, we explore properties of the optimization landscapes of the deep linear neural network models. After clarifying on the various definitions of "flat" mini…

Deep Networks on Toroids: Removing Symmetries Reveals the Structure of Flat Regions in the Landscape Geometry

2022-02-07 · Fabrizio Pittorino, Antonio Ferraro, Gabriele Perugini, Christoph Feinauer 외

We systematize the approach to the investigation of deep neural network landscapes by basing it on the geometry of the space of implemented functions rather than the space of parameters. Grouping classifiers into equival…