paper-with-me

Papers

Learning Broken Symmetries with Approximate Invariance

2024-12-25 · Seth Nabat, Aishik Ghosh, Edmund Witkowski, Gregor Kasieczka, Daniel Whiteson

Recognizing symmetries in data allows for significant boosts in neural network training, which is especially important where training data are limited. In many cases, however, the exact underlying symmetry is present only in an idealized dataset, and is broken in actual data, due to asymmetries in the detector, or varying response resolution as a function of particle momentum. Standard approaches, such as data augmentation or equivariant networks fail to represent the nature of the full, broken symmetry, effectively overconstraining the response of the neural network. We propose a learning model which balances the generality and asymptotic performance of unconstrained networks with the rapid learning of constrained networks. This is achieved through a dual-subnet structure, where one network is constrained by the symmetry and the other is not, along with a learned symmetry factor. In a simplified toy example that demonstrates violation of Lorentz invariance, our model learns as rapidly as symmetry-constrained networks but escapes its performance limitations.

📄 PDF Abstract BibTeX arXiv:2412.18773

Code (1)

atomicsorcerer/learning-broken-symmetries 공식 구현 pytorch

Tasks

Data Augmentation

Similar Papers 제목 키워드 기반

Symmetry's Edge in Cortical Dynamics: Multiscale Dynamics of Ensemble Excitation and Inhibition

2023-06-21 · Nima Dehghani

Creating a quantitative theory for the cortex presents challenges and raises questions. What are the significant scales--micro, meso, or macroscopic? What are the interactions--pairwise, higher order, or mean-field? And …

Using and Abusing Equivariance

2023-08-22 · Tom Edixhoven, Attila Lengyel, Jan van Gemert

In this paper we show how Group Equivariant Convolutional Neural Networks use subsampling to learn to break equivariance to their symmetries. We focus on 2D rotations and reflections and investigate the impact of broken …

Probing the effects of broken symmetries in machine learning

2024-06-25 · Marcel F. Langer, Sergey N. Pozdnyakov, Michele Ceriotti

Symmetry is one of the most central concepts in physics, and it is no surprise that it has also been widely adopted as an inductive bias for machine-learning models applied to the physical sciences. This is especially tr…

Inductive Bias

Unsupervised Learning of Invariance Transformations

2023-07-24 · Aleksandar Vučković, Benedikt Stock, Alexander V. Hopp, Mathias Winkel 외

The need for large amounts of training data in modern machine learning is one of the biggest challenges of the field. Compared to the brain, current artificial algorithms are much less capable of learning invariance tran…

Target localization, identification and sensing using latent symmetries

2026-05-31 · David Dukov, Malte Röntgen, Bryn Davies arxiv

We show that an array of scatterers which has been designed to have latent ("hidden") symmetries can be used as a sensor. We use the capacitance matrix as a canonical model for three-dimensional hybridisation and study h…

Bayesian Inference