paper-with-me

홈 › Papers

Local Group Invariant Representations via Orbit Embeddings

2016-12-06 · Anant Raj, Abhishek Kumar, Youssef Mroueh, P. Thomas Fletcher, Bernhard Schölkopf

Invariance to nuisance transformations is one of the desirable properties of effective representations. We consider transformations that form a \emph{group} and propose an approach based on kernel methods to derive local group invariant representations. Locality is achieved by defining a suitable probability distribution over the group which in turn induces distributions in the input feature space. We learn a decision function over these distributions by appealing to the powerful framework of kernel methods and generate local invariant random feature maps via kernel approximations. We show uniform convergence bounds for kernel approximation and provide excess risk bounds for learning with these features. We evaluate our method on three real datasets, including Rotated MNIST and CIFAR-10, and observe that it outperforms competing kernel based approaches. The proposed method also outperforms deep CNN on Rotated-MNIST and performs comparably to the recently proposed group-equivariant CNN.

📄 PDF Abstract BibTeX arXiv:1612.01988

Code (0)

등록된 구현이 없습니다.

Tasks

Rotated MNIST

Similar Papers 제목 키워드 기반

Group-invariant Coresets for Data-efficient Active Learning

2026-07-01 · L. C. Ayres, J. C. M. Bermudez, S. J. M. de Almeida, R. A. Borsoi arxiv

Active learning reduces labeling cost by querying the most informative unlabeled samples, but standard coreset methods ignore known data symmetries and can waste budget on transformed versions of the same instance. We pr…

Active Learning

Stability of sorting based embeddings

2024-10-07 · Radu Balan, Efstratios Tsoukanis, Matthias Wellershoff

Consider a group $G$ of order $M$ acting unitarily on a real inner product space $V$. We show that the sorting based embedding obtained by applying a general linear map $\alpha : \mathbb{R}^{M \times N} \to \mathbb{R}^D$…

Group Invariant Global Pooling

2023-05-30 · Kamil Bujel, Yonatan Gideoni, Chaitanya K. Joshi, Pietro Liò

Much work has been devoted to devising architectures that build group-equivariant representations, while invariance is often induced using simple global pooling mechanisms. Little work has been done on creating expressiv…

Rotated MNIST

Dictionary Learning under Symmetries via Group Representations

2023-05-31 · Subhroshekhar Ghosh, Aaron Y. R. Low, Yong Sheng Soh, Zhuohang Feng 외

The dictionary learning problem can be viewed as a data-driven process to learn a suitable transformation so that data is sparsely represented directly from example data. In this paper, we examine the problem of learning…

Dictionary LearningDimensionality ReductionMulti-Object TrackingObject Tracking+1

Representing and Learning Functions Invariant Under Crystallographic Groups

2023-06-08 · Ryan P. Adams, Peter Orbanz

Crystallographic groups describe the symmetries of crystals and other repetitive structures encountered in nature and the sciences. These groups include the wallpaper and space groups. We derive linear and nonlinear repr…

Gaussian Processes