RandMSAugment: A Mixed-Sample Augmentation for Limited-Data Scenarios
The high costs of annotating large datasets suggests a need for effectively training CNNs with limited data, and data augmentation is a promising direction. We study foundational augmentation techniques, including Mixed Sample Data Augmentations (MSDAs) and a no-parameter variant of RandAugment termed Preset-RandAugment, in the fully supervised scenario. We observe that Preset-RandAugment excels in limited-data contexts while MSDAs are moderately effective. We show that low-level feature transforms play a pivotal role in this performance difference, postulate a new property of augmentations related to their data efficiency, and propose new ways to measure the diversity and realism of augmentations. Building on these insights, we introduce a novel augmentation technique called RandMSAugment that integrates complementary strengths of existing methods. RandMSAugment significantly outperforms the competition on CIFAR-100, STL-10, and Tiny-Imagenet. With very small training sets (4, 25, 100 samples/class), RandMSAugment achieves compelling performance gains between 4.1% and 6.75%. Even with more training data (500 samples/class) we improve performance by 1.03% to 2.47%. RandMSAugment does not require hyperparameter tuning, extra validation data, or cumbersome optimizations.
Code (0)
등록된 구현이 없습니다.
Tasks
Data AugmentationDiversityMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
CP2M: Clustered-Patch-Mixed Mosaic Augmentation for Aerial Image Segmentation
Remote sensing image segmentation is pivotal for earth observation, underpinning applications such as environmental monitoring and urban planning. Due to the limited annotation data available in remote sensing images, nu…
Data AugmentationDiversityEarth ObservationImage Segmentation+1Analyzing Effects of Mixed Sample Data Augmentation on Model Interpretability
Data augmentation strategies are actively used when training deep neural networks (DNNs). Recent studies suggest that they are effective at various tasks. However, the effect of data augmentation on DNNs' interpretabilit…
Data AugmentationExploiting Mixed Unlabeled Data for Detecting Samples of Seen and Unseen Out-of-Distribution Classes
Out-of-Distribution (OOD) detection is essential in real-world applications, which has attracted increasing attention in recent years. However, most existing OOD detection methods require many labeled In-Distribution (ID…
Data AugmentationOut of Distribution (OOD) DetectionRandoMix: A mixed sample data augmentation method with multiple mixed modes
Data augmentation plays a crucial role in enhancing the robustness and performance of machine learning models across various domains. In this study, we introduce a novel mixed-sample data augmentation method called Rando…
Data AugmentationDiversityDeep Regularized Waveform Learning for Beam Prediction With Limited Samples in Non-Cooperative mmWave Systems
Millimeter wave (mmWave) systems need beam management to establish and maintain reliable links. This complex and time-consuming process seriously affects communication efficiency. Benefiting from data-driven technology i…
Beam PredictionData Augmentation