paper-with-me

홈 › Papers

Learning Instance-Specific Augmentations by Capturing Local Invariances

2022-05-31 · Ning Miao, Tom Rainforth, Emile Mathieu, Yann Dubois, Yee Whye Teh, Adam Foster, Hyunjik Kim

We introduce InstaAug, a method for automatically learning input-specific augmentations from data. Previous methods for learning augmentations have typically assumed independence between the original input and the transformation applied to that input. This can be highly restrictive, as the invariances we hope our augmentation will capture are themselves often highly input dependent. InstaAug instead introduces a learnable invariance module that maps from inputs to tailored transformation parameters, allowing local invariances to be captured. This can be simultaneously trained alongside the downstream model in a fully end-to-end manner, or separately learned for a pre-trained model. We empirically demonstrate that InstaAug learns meaningful input-dependent augmentations for a wide range of transformation classes, which in turn provides better performance on both supervised and self-supervised tasks.

📄 PDF Abstract BibTeX arXiv:2206.00051

Code (1)

ningmiao/instaaug 공식 구현 pytorch

Tasks

Data Augmentation

Methods 이 논문이 사용한 방법론

BASE 설명 없음

Similar Papers 제목 키워드 기반

MAST: Masked Augmentation Subspace Training for Generalizable Self-Supervised Priors

2023-03-07 · Chen Huang, Hanlin Goh, Jiatao Gu, Josh Susskind

Recent Self-Supervised Learning (SSL) methods are able to learn feature representations that are invariant to different data augmentations, which can then be transferred to downstream tasks of interest. However, differen…

Instance SegmentationSelf-Supervised LearningSemantic Segmentation

Learning Invariances in Neural Networks

2020-10-22 · Gregory Benton, Marc Finzi, Pavel Izmailov, Andrew Gordon Wilson

Invariances to translations have imbued convolutional neural networks with powerful generalization properties. However, we often do not know a priori what invariances are present in the data, or to what extent a model sh…

image-classificationImage ClassificationMolecular Property PredictionProperty Prediction+1

Learning Invariances in Neural Networks from Training Data

2020-12-01 · NeurIPS 2020 12 · Gregory Benton, Marc Finzi, Pavel Izmailov, Andrew Gordon Wilson

Invariances to translations have imbued convolutional neural networks with powerful generalization properties. However, we often do not know a priori what invariances are present in the data, or to what extent a model sh…

image-classificationImage ClassificationMolecular Property PredictionProperty Prediction

Grounding inductive biases in natural images:invariance stems from variations in data

2021-06-09 · NeurIPS 2021 12 · Diane Bouchacourt, Mark Ibrahim, Ari S. Morcos

To perform well on unseen and potentially out-of-distribution samples, it is desirable for machine learning models to have a predictable response with respect to transformations affecting the factors of variation of the …

Data AugmentationTranslation

Grounding inductive biases in natural images: invariance stems from variations in data

2021-05-21 · NeurIPS 2021 12 · Diane Bouchacourt, Mark Ibrahim, Ari S. Morcos

To perform well on unseen and potentially out-of-distribution samples, it is desirable for machine learning models to have a predictable response with respect to transformations affecting the factors of variation of the …

Data AugmentationTranslation