paper-with-me

홈 › Papers

A Simple Strategy to Provable Invariance via Orbit Mapping

2022-09-24 · Kanchana Vaishnavi Gandikota, Jonas Geiping, Zorah Lähner, Adam Czapliński, Michael Moeller

Many applications require robustness, or ideally invariance, of neural networks to certain transformations of input data. Most commonly, this requirement is addressed by training data augmentation, using adversarial training, or defining network architectures that include the desired invariance by design. In this work, we propose a method to make network architectures provably invariant with respect to group actions by choosing one element from a (possibly continuous) orbit based on a fixed criterion. In a nutshell, we intend to 'undo' any possible transformation before feeding the data into the actual network. Further, we empirically analyze the properties of different approaches which incorporate invariance via training or architecture, and demonstrate the advantages of our method in terms of robustness and computational efficiency. In particular, we investigate the robustness with respect to rotations of images (which can hold up to discretization artifacts) as well as the provable orientation and scaling invariance of 3D point cloud classification.

📄 PDF Abstract BibTeX arXiv:2209.11916

Code (0)

등록된 구현이 없습니다.

Tasks

3D Point Cloud ClassificationComputational EfficiencyData AugmentationPoint Cloud Classification

Similar Papers 제목 키워드 기반

Training or Architecture? How to Incorporate Invariance in Neural Networks

2021-06-18 · Kanchana Vaishnavi Gandikota, Jonas Geiping, Zorah Lähner, Adam Czapliński 외

Many applications require the robustness, or ideally the invariance, of a neural network to certain transformations of input data. Most commonly, this requirement is addressed by either augmenting the training data, usin…

3D Point Cloud ClassificationComputational EfficiencyPoint Cloud Classification

Implicit Bias and Invariance: How Hopfield Networks Efficiently Learn Graph Orbits

2025-12-16 · Michael Murray, Tenzin Chan, Kedar Karhadker, Christopher J. Hillar arxiv

Many learning problems are organized by group symmetries. While invariance is often imposed through architectures or group averaging, we ask when it can emerge from training on a finite random subset of an orbit. We stud…

Invariance-Aware Randomized Smoothing Certificates

2022-11-25 · Jan Schuchardt, Stephan Günnemann

Building models that comply with the invariances inherent to different domains, such as invariance under translation or rotation, is a key aspect of applying machine learning to real world problems like molecular propert…

Molecular Property PredictionProperty PredictionProtein Folding

Path following of a class of underactuated mechanical systems via immersion and invariance-based orbital stabilization

2020-01-28

This paper aims to provide a new problem formulation of path following for mechanical systems without time parameterization nor guidance laws, namely, we express the control objective as an orbital stabilization problem.…

On genuine invariance learning without weight-tying

2023-08-07 · Artem Moskalev, Anna Sepliarskaia, Erik J. Bekkers, Arnold Smeulders

In this paper, we investigate properties and limitations of invariance learned by neural networks from the data compared to the genuine invariance achieved through invariant weight-tying. To do so, we adopt a group theor…

Decision Making