paper-with-me

Papers

Learning with Group Invariant Features: A Kernel Perspective

2015-06-08 · NeurIPS 2015 · Youssef Mroueh, Stephen Voinea, Tomaso Poggio

We analyze in this paper a random feature map based on a theory of invariance I-theory introduced recently. More specifically, a group invariant signal signature is obtained through cumulative distributions of group transformed random projections. Our analysis bridges invariant feature learning with kernel methods, as we show that this feature map defines an expected Haar integration kernel that is invariant to the specified group action. We show how this non-linear random feature map approximates this group invariant kernel uniformly on a set of $N$ points. Moreover, we show that it defines a function space that is dense in the equivalent Invariant Reproducing Kernel Hilbert Space. Finally, we quantify error rates of the convergence of the empirical risk minimization, as well as the reduction in the sample complexity of a learning algorithm using such an invariant representation for signal classification, in a classical supervised learning setting.

📄 PDF Abstract BibTeX arXiv:1506.02544

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Learning with Group Invariant Features: A Kernel Perspective.

2015-12-01 · NeurIPS 2015 12 · Youssef Mroueh, Stephen Voinea, Tomaso A. Poggio

We analyze in this paper a random feature map based on a theory of invariance (\emph{I-theory}) introduced in \cite{AnselmiLRMTP13}. More specifically, a group invariant signal signature is obtained through cumulative …

Unitary-Group Invariant Kernels and Features from Transformed Unlabeled Data

2015-11-18 · Dipan K. Pal, Marios Savvides

The study of representations invariant to common transformations of the data is important to learning. Most techniques have focused on local approximate invariance implemented within expensive optimization frameworks lac…

Local Group Invariant Representations via Orbit Embeddings

2016-12-06 · Anant Raj, Abhishek Kumar, Youssef Mroueh, P. Thomas Fletcher 외

Invariance to nuisance transformations is one of the desirable properties of effective representations. We consider transformations that form a \emph{group} and propose an approach based on kernel methods to derive local…

Rotated MNIST

The Exact Sample Complexity Gain from Invariances for Kernel Regression

2023-03-24 · NeurIPS 2023 11

In practice, encoding invariances into models improves sample complexity. In this work, we study this phenomenon from a theoretical perspective. In particular, we provide minimax optimal rates for kernel ridge regression…

regression

Learning with invariances in random features and kernel models

2021-02-25 · Song Mei, Theodor Misiakiewicz, Andrea Montanari

A number of machine learning tasks entail a high degree of invariance: the data distribution does not change if we act on the data with a certain group of transformations. For instance, labels of images are invariant und…

Data Augmentation