paper-with-me

Papers

Group invariant machine learning by fundamental domain projections

2022-02-04 · Benjamin Aslan, Daniel Platt, David Sheard

We approach the well-studied problem of supervised group invariant and equivariant machine learning from the point of view of geometric topology. We propose a novel approach using a pre-processing step, which involves projecting the input data into a geometric space which parametrises the orbits of the symmetry group. This new data can then be the input for an arbitrary machine learning model (neural network, random forest, support-vector machine etc). We give an algorithm to compute the geometric projection, which is efficient to implement, and we illustrate our approach on some example machine learning problems (including the well-studied problem of predicting Hodge numbers of CICY matrices), in each case finding an improvement in accuracy versus others in the literature. The geometric topology viewpoint also allows us to give a unified description of so-called intrinsic approaches to group equivariant machine learning, which encompasses many other approaches in the literature.

📄 PDF Abstract BibTeX arXiv:2202.02164

Code (0)

등록된 구현이 없습니다.

Tasks

BIG-bench Machine Learning

Similar Papers 제목 키워드 기반

Learning with Group Invariant Features: A Kernel Perspective

2015-06-08 · NeurIPS 2015 · Youssef Mroueh, Stephen Voinea, Tomaso Poggio

We analyze in this paper a random feature map based on a theory of invariance I-theory introduced recently. More specifically, a group invariant signal signature is obtained through cumulative distributions of group tran…

Learning with Group Invariant Features: A Kernel Perspective.

2015-12-01 · NeurIPS 2015 12 · Youssef Mroueh, Stephen Voinea, Tomaso A. Poggio

We analyze in this paper a random feature map based on a theory of invariance (\emph{I-theory}) introduced in \cite{AnselmiLRMTP13}. More specifically, a group invariant signal signature is obtained through cumulative …

Invariants of objects and their images under surjective maps

2015-09-22 · Irina A. Kogan, Peter J. Olver

We examine the relationships between the differential invariants of objects and of their images under a surjective map. We analyze both the case when the underlying transformation group is projectable and hence induces a…

Unnatural Algorithms in Machine Learning

2023-12-07 · Christian Goodbrake

Natural gradient descent has a remarkable property that in the small learning rate limit, it displays an invariance with respect to network reparameterizations, leading to robust training behavior even for highly covaria…

On the Universality of Invariant Networks

2019-01-27 · Haggai Maron, Ethan Fetaya, Nimrod Segol, Yaron Lipman

Constraining linear layers in neural networks to respect symmetry transformations from a group $G$ is a common design principle for invariant networks that has found many applications in machine learning. In this paper, …