paper-with-me

홈 › Papers

Equivariant Frames and the Impossibility of Continuous Canonicalization

2024-02-25 · Nadav Dym, Hannah Lawrence, Jonathan W. Siegel

Canonicalization provides an architecture-agnostic method for enforcing equivariance, with generalizations such as frame-averaging recently gaining prominence as a lightweight and flexible alternative to equivariant architectures. Recent works have found an empirical benefit to using probabilistic frames instead, which learn weighted distributions over group elements. In this work, we provide strong theoretical justification for this phenomenon: for commonly-used groups, there is no efficiently computable choice of frame that preserves continuity of the function being averaged. In other words, unweighted frame-averaging can turn a smooth, non-symmetric function into a discontinuous, symmetric function. To address this fundamental robustness problem, we formally define and construct \emph{weighted} frames, which provably preserve continuity, and demonstrate their utility by constructing efficient and continuous weighted frames for the actions of $SO(2)$, $SO(3)$, and $S_n$ on point clouds.

📄 PDF Abstract BibTeX arXiv:2402.16077

Code (1)

jwsiegel2510/sn-invariant-weighted-frames 공식 구현 jax

Similar Papers 제목 키워드 기반

A Canonicalization Perspective on Invariant and Equivariant Learning

2024-05-28 · George Ma, Yifei Wang, Derek Lim, Stefanie Jegelka 외

In many applications, we desire neural networks to exhibit invariance or equivariance to certain groups due to symmetries inherent in the data. Recently, frame-averaging methods emerged to be a unified framework for atta…

Graph ClassificationGraph EmbeddingGraph Regression

Equivariance by Local Canonicalization: A Matter of Representation

2025-09-30 · Gerrit Gerhartz, Peter Lippmann, Fred A. Hamprecht arxiv

Equivariant neural networks offer strong inductive biases for learning from molecular and geometric data but often rely on specialized, computationally expensive tensor operations. We present a framework to transfers exi…

Adaptive Canonicalization with Application to Invariant Anisotropic Geometric Networks

2025-09-29 · Ya-Wei Eileen Lin, Ron Levie arxiv

Canonicalization is a widely used strategy in equivariant machine learning, enforcing symmetry in neural networks by mapping each input to a standard form. Yet, it often introduces discontinuities that can affect stabili…

Point Cloud ClassificationData AugmentationPoint Clouds

Lorentz Local Canonicalization: How to Make Any Network Lorentz-Equivariant

2025-05-26 · Jonas Spinner, Luigi Favaro, Peter Lippmann, Sebastian Pitz 외

Lorentz-equivariant neural networks are becoming the leading architectures for high-energy physics. Current implementations rely on specialized layers, limiting architectural choices. We introduce Lorentz Local Canonical…

Data Augmentation

Lie Algebra Canonicalization: Equivariant Neural Operators under arbitrary Lie Groups

2024-10-03 · Zakhar Shumaylov, Peter Zaika, James Rowbottom, Ferdia Sherry 외

The quest for robust and generalizable machine learning models has driven recent interest in exploiting symmetries through equivariant neural networks. In the context of PDE solvers, recent works have shown that Lie poin…

image-classificationImage ClassificationInductive Bias