paper-with-me

홈 › Papers

Symmetry-Breaking Descent for Invariant Cost Functionals

2025-05-19 · Mikhail Osipov

We study the problem of reducing a task cost functional $W(S)$, defined over Sobolev-class signals $S$, when the cost is invariant under a global symmetry group $G \subset \mathrm{Diff}(M)$ and accessible only as a black-box. Such scenarios arise in machine learning, imaging, and inverse problems, where cost metrics reflect model outputs or performance scores but are non-differentiable and model-internal. We propose a variational method that exploits the symmetry structure to construct explicit, symmetry-breaking deformations of the input signal. A gauge field $\phi$, obtained by minimizing an auxiliary energy functional, induces a deformation $h = A_\phi[S]$ that generically lies transverse to the $G$-orbit of $S$. We prove that, under mild regularity, the cost $W$ strictly decreases along this direction -- either via Clarke subdifferential descent or by escaping locally flat plateaus. The exceptional set of degeneracies has zero Gaussian measure. Our approach requires no access to model gradients or labels and operates entirely at test time. It provides a principled tool for optimizing invariant cost functionals via Lie-algebraic variational flows, with applications to black-box models and symmetry-constrained tasks.

📄 PDF Abstract BibTeX arXiv:2505.13578

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically

Similar Papers 제목 키워드 기반

To Augment or Not to Augment? Diagnosing Distributional Symmetry Breaking

2025-10-01 · Hannah Lawrence, Elyssa Hofgard, Vasco Portilheiro, Yuxuan Chen 외 arxiv

Symmetry-aware methods for machine learning, such as data augmentation and equivariant architectures, encourage correct model behavior on all transformations (e.g. rotations or permutations) of the original dataset. Thes…

Data Augmentation

Partially Equivariant Reinforcement Learning in Symmetry-Breaking Environments

2025-11-30 · Junwoo Chang, Minwoo Park, Joohwan Seo, Roberto Horowitz 외 arxiv

Group symmetries provide a powerful inductive bias for reinforcement learning (RL), enabling efficient generalization across symmetric states and actions via group-invariant Markov Decision Processes (MDPs). However, rea…

Reinforcement LearningContinuous Control

Improving Optimization for Models With Continuous Symmetry Breaking

2018-03-08 · Robert Bamler, Stephan Mandt

Many loss functions in representation learning are invariant under a continuous symmetry transformation. For example, the loss function of word embeddings (Mikolov et al., 2013) remains unchanged if we simultaneously rot…

Representation LearningTime SeriesTime Series AnalysisWord Embeddings

Improving Optimization in Models With Continuous Symmetry Breaking

2018-07-01 · ICML 2018 7 · Robert Bamler, Stephan Mandt

Many loss functions in representation learning are invariant under a continuous symmetry transformation. For example, the loss function of word embeddings (Mikolov et al., 2013) remains unchanged if we simultaneousl…

Representation LearningTime SeriesTime Series AnalysisWord Embeddings

Symmetry & Critical Points

2024-08-26 · Yossi Arjevani

Critical points of an invariant function may or may not be symmetric. We prove, however, that if a symmetric critical point exists, those adjacent to it are generically symmetry breaking. This mathematical mechanism is s…