A Simple Strategy to Provable Invariance via Orbit Mapping
Many applications require robustness, or ideally invariance, of neural networks to certain transformations of input data. Most commonly, this requirement is addressed by training data augmentation, using adversarial training, or defining network architectures that include the desired invariance by design. In this work, we propose a method to make network architectures provably invariant with respect to group actions by choosing one element from a (possibly continuous) orbit based on a fixed criterion. In a nutshell, we intend to 'undo' any possible transformation before feeding the data into the actual network. Further, we empirically analyze the properties of different approaches which incorporate invariance via training or architecture, and demonstrate the advantages of our method in terms of robustness and computational efficiency. In particular, we investigate the robustness with respect to rotations of images (which can hold up to discretization artifacts) as well as the provable orientation and scaling invariance of 3D point cloud classification.
Code (0)
등록된 구현이 없습니다.
Tasks
3D Point Cloud ClassificationComputational EfficiencyData AugmentationPoint Cloud ClassificationSimilar Papers 제목 키워드 기반
Training or Architecture? How to Incorporate Invariance in Neural Networks
Many applications require the robustness, or ideally the invariance, of a neural network to certain transformations of input data. Most commonly, this requirement is addressed by either augmenting the training data, usin…
3D Point Cloud ClassificationComputational EfficiencyPoint Cloud ClassificationImplicit Bias and Invariance: How Hopfield Networks Efficiently Learn Graph Orbits
Many learning problems are organized by group symmetries. While invariance is often imposed through architectures or group averaging, we ask when it can emerge from training on a finite random subset of an orbit. We stud…
Invariance-Aware Randomized Smoothing Certificates
Building models that comply with the invariances inherent to different domains, such as invariance under translation or rotation, is a key aspect of applying machine learning to real world problems like molecular propert…
Molecular Property PredictionProperty PredictionProtein FoldingPath following of a class of underactuated mechanical systems via immersion and invariance-based orbital stabilization
This paper aims to provide a new problem formulation of path following for mechanical systems without time parameterization nor guidance laws, namely, we express the control objective as an orbital stabilization problem.…
On genuine invariance learning without weight-tying
In this paper, we investigate properties and limitations of invariance learned by neural networks from the data compared to the genuine invariance achieved through invariant weight-tying. To do so, we adopt a group theor…
Decision Making