paper-with-me

홈 › Papers

Learning Polynomial Problems with $SL(2,\mathbb{R})$ Equivariance

2023-12-04 · Hannah Lawrence, Mitchell Tong Harris

Optimizing and certifying the positivity of polynomials are fundamental primitives across mathematics and engineering applications, from dynamical systems to operations research. However, solving these problems in practice requires large semidefinite programs, with poor scaling in dimension and degree. In this work, we demonstrate for the first time that neural networks can effectively solve such problems in a data-driven fashion, achieving tenfold speedups while retaining high accuracy. Moreover, we observe that these polynomial learning problems are equivariant to the non-compact group $SL(2,\mathbb{R})$, which consists of area-preserving linear transformations. We therefore adapt our learning pipelines to accommodate this structure, including data augmentation, a new $SL(2,\mathbb{R})$-equivariant architecture, and an architecture equivariant with respect to its maximal compact subgroup, $SO(2, \mathbb{R})$. Surprisingly, the most successful approaches in practice do not enforce equivariance to the entire group, which we prove arises from an unusual lack of architecture universality for $SL(2,\mathbb{R})$ in particular. A consequence of this result, which is of independent interest, is that there exists an equivariant function for which there is no sequence of equivariant polynomials multiplied by arbitrary invariants that approximates the original function. This is a rare example of a symmetric problem where data augmentation outperforms a fully equivariant architecture, and provides interesting lessons in both theory and practice for other problems with non-compact symmetries.

📄 PDF Abstract BibTeX arXiv:2312.02146

Code (0)

등록된 구현이 없습니다.

Tasks

Data Augmentation

Similar Papers 제목 키워드 기반

Low-degree lower bounds via almost orthonormal bases

2025-09-11 · Alexandra Carpentier, Simone Maria Giancola, Christophe Giraud, Nicolas Verzelen arxiv

Low-degree polynomials have emerged as a powerful paradigm for providing evidence of statistical-computational gaps across a variety of high-dimensional statistical models [Wein25]. For detection problems -- where the go…

Shift-Equivariant Complex-Valued Convolutional Neural Networks

2025-11-26 · Quentin Gabot, Teck-Yian Lim, Jérémy Fix, Joana Frontera-Pons 외 arxiv

Convolutional neural networks have shown remarkable performance in recent years on various computer vision problems. However, the traditional convolutional neural network architecture lacks a critical property: shift equ…

Semantic SegmentationData Augmentation

Representation Learning on Unit Ball with 3D Roto-Translational Equivariance

2019-11-30 · Sameera Ramasinghe, Salman Khan, Nick Barnes, Stephen Gould

Convolution is an integral operation that defines how the shape of one function is modified by another function. This powerful concept forms the basis of hierarchical feature learning in deep neural networks. Although pe…

3D Object RecognitionObject RecognitionRepresentation Learning

Clifford-Steerable Convolutional Neural Networks

2024-02-22 · Maksim Zhdanov, David Ruhe, Maurice Weiler, Ana Lucic 외

We present Clifford-Steerable Convolutional Neural Networks (CS-CNNs), a novel class of $\mathrm{E}(p, q)$-equivariant CNNs. CS-CNNs process multivector fields on pseudo-Euclidean spaces $\mathbb{R}^{p,q}$. They cover, f…

Testing for Geometric Invariance and Equivariance

2022-05-30 · Louis G. Christie, John A. D. Aston

Invariant and equivariant models incorporate the symmetry of an object to be estimated (here non-parametric regression functions $f : \mathcal{X} \rightarrow \mathbb{R}$). These models perform better (with respect to $L^…

regression