paper-with-me

홈 › Papers

SAGE: Saliency-Guided Mixup with Optimal Rearrangements

2022-10-31 · Avery Ma, Nikita Dvornik, Ran Zhang, Leila Pishdad, Konstantinos G. Derpanis, Afsaneh Fazly

Data augmentation is a key element for training accurate models by reducing overfitting and improving generalization. For image classification, the most popular data augmentation techniques range from simple photometric and geometrical transformations, to more complex methods that use visual saliency to craft new training examples. As augmentation methods get more complex, their ability to increase the test accuracy improves, yet, such methods become cumbersome, inefficient and lead to poor out-of-domain generalization, as we show in this paper. This motivates a new augmentation technique that allows for high accuracy gains while being simple, efficient (i.e., minimal computation overhead) and generalizable. To this end, we introduce Saliency-Guided Mixup with Optimal Rearrangements (SAGE), which creates new training examples by rearranging and mixing image pairs using visual saliency as guidance. By explicitly leveraging saliency, SAGE promotes discriminative foreground objects and produces informative new images useful for training. We demonstrate on CIFAR-10 and CIFAR-100 that SAGE achieves better or comparable performance to the state of the art while being more efficient. Additionally, evaluations in the out-of-distribution setting, and few-shot learning on mini-ImageNet, show that SAGE achieves improved generalization performance without trading off robustness.

📄 PDF Abstract BibTeX arXiv:2211.00113

Code (0)

등록된 구현이 없습니다.

Tasks

Data AugmentationDomain GeneralizationFew-Shot Learningimage-classificationImage Classification

Methods 이 논문이 사용한 방법론

Test 설명 없음
Mixup Mixup is a data augmentation technique that generates a weighted combination of random image pairs from the training data. Given two images and their ground truth labels:…

Similar Papers 제목 키워드 기반

SageMix: Saliency-Guided Mixup for Point Clouds

2022-10-13 · Sanghyeok Lee, Minkyu Jeon, Injae Kim, Yunyang Xiong 외

Data augmentation is key to improving the generalization ability of deep learning models. Mixup is a simple and widely-used data augmentation technique that has proven effective in alleviating the problems of overfitting…

3D Part Segmentation3D Point Cloud Classification3D Point Cloud Data AugmentationData Augmentation+2

GuidedMixup: An Efficient Mixup Strategy Guided by Saliency Maps

2023-06-29 · Minsoo Kang, Suhyun Kim

Data augmentation is now an essential part of the image training process, as it effectively prevents overfitting and makes the model more robust against noisy datasets. Recent mixing augmentation strategies have advanced…

Data Augmentation

TokenMixup: Efficient Attention-guided Token-level Data Augmentation for Transformers

2022-10-14 · Hyeong Kyu Choi, Joonmyung Choi, Hyunwoo J. Kim

Mixup is a commonly adopted data augmentation technique for image classification. Recent advances in mixup methods primarily focus on mixing based on saliency. However, many saliency detectors require intense computation…

Data Augmentationimage-classificationImage Classification

Co-Mixup: Saliency Guided Joint Mixup with Supermodular Diversity

2021-02-05 · ICLR 2021 1 · Jang-Hyun Kim, Wonho Choo, Hosan Jeong, Hyun Oh Song

While deep neural networks show great performance on fitting to the training distribution, improving the networks' generalization performance to the test distribution and robustness to the sensitivity to input perturbati…

Diversity

On the Calibration of Pre-trained Language Models using Mixup Guided by Area Under the Margin and Saliency

2022-03-14 · ACL 2022 5 · Seo Yeon Park, Cornelia Caragea

A well-calibrated neural model produces confidence (probability outputs) closely approximated by the expected accuracy. While prior studies have shown that mixup training as a data augmentation technique can improve mode…

Data Augmentationimage-classificationImage ClassificationNatural Language Inference+1