paper-with-me

홈 › Papers

RangeAugment: Efficient Online Augmentation with Range Learning

2022-12-20 · Sachin Mehta, Saeid Naderiparizi, Fartash Faghri, Maxwell Horton, Lailin Chen, Ali Farhadi, Oncel Tuzel, Mohammad Rastegari

State-of-the-art automatic augmentation methods (e.g., AutoAugment and RandAugment) for visual recognition tasks diversify training data using a large set of augmentation operations. The range of magnitudes of many augmentation operations (e.g., brightness and contrast) is continuous. Therefore, to make search computationally tractable, these methods use fixed and manually-defined magnitude ranges for each operation, which may lead to sub-optimal policies. To answer the open question on the importance of magnitude ranges for each augmentation operation, we introduce RangeAugment that allows us to efficiently learn the range of magnitudes for individual as well as composite augmentation operations. RangeAugment uses an auxiliary loss based on image similarity as a measure to control the range of magnitudes of augmentation operations. As a result, RangeAugment has a single scalar parameter for search, image similarity, which we simply optimize via linear search. RangeAugment integrates seamlessly with any model and learns model- and task-specific augmentation policies. With extensive experiments on the ImageNet dataset across different networks, we show that RangeAugment achieves competitive performance to state-of-the-art automatic augmentation methods with 4-5 times fewer augmentation operations. Experimental results on semantic segmentation, object detection, foundation models, and knowledge distillation further shows RangeAugment's effectiveness.

📄 PDF Abstract BibTeX arXiv:2212.10553

Code (1)

apple/ml-cvnets 공식 구현 pytorch

Tasks

Knowledge Distillationobject-detectionObject DetectionOpen-Ended Question AnsweringSemantic Segmentation

Methods 이 논문이 사용한 방법론

Sigmoid Activation 설명 없음
Tanh Activation 설명 없음
Knowledge Distillation A very simple way to improve the performance of almost any machine learning algorithm is to train many different models on the same data and then to average their predictions.…
LSTM An LSTM is a type of recurrent neural network that addresses the vanishing gradient problem in vanilla…
AutoAugment 설명 없음

Similar Papers 제목 키워드 기반

A Theory of Contrastive Learning with Natural Images

2026-07-08 · Antonio Torralba, Yair Weiss arxiv

Why does contrastive learning with simple images and augmentations yield useful representations for downstream tasks? We address this question by analytically computing the optimal representation in terms of a contrastiv…

Contrastive Learning

StoRIR: Stochastic Room Impulse Response Generation for Audio Data Augmentation

2020-08-17 · Piotr Masztalski, Mateusz Matuszewski, Karol Piaskowski, Michał Romaniuk

In this paper we introduce StoRIR - a stochastic room impulse response generation method dedicated to audio data augmentation in machine learning applications. This technique, in contrary to geometrical methods like imag…

Data AugmentationResponse GenerationRoom Impulse Response (RIR)Speech Enhancement

Online Continual Learning via the Meta-learning Update with Multi-scale Knowledge Distillation and Data Augmentation

2022-09-12 · Ya-nan Han, Jian-wei Liu

Continual learning aims to rapidly and continually learn the current task from a sequence of tasks. Compared to other kinds of methods, the methods based on experience replay have shown great advantages to overcome catas…

Continual LearningData AugmentationKnowledge DistillationMeta-Learning

OnlineAugment: Online Data Augmentation with Less Domain Knowledge

2020-07-17 · ECCV 2020 8 · Zhiqiang Tang, Yunhe Gao, Leonid Karlinsky, Prasanna Sattigeri 외

Data augmentation is one of the most important tools in training modern deep neural networks. Recently, great advances have been made in searching for optimal augmentation policies in the image classification domain. How…

Data Augmentationimage-classificationImage Classification

Augmenty: A Python Library for Structured Text Augmentation

2023-12-09 · Kenneth Enevoldsen

Augmnety is a Python library for structured text augmentation. It is built on top of spaCy and allows for augmentation of both the text and its annotations. Augmenty provides a wide range of augmenters which can be combi…

Dependency Parsingnamed-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)+3