Synthetic Augmentation in Imbalanced Learning: When It Helps, When It Hurts, and How Much to Add
Imbalanced classification often causes standard training procedures to prioritize the majority class and perform poorly on rare but important cases. A classic and widely used remedy is to augment the minority class with synthetic samples, but two basic questions remain under-resolved: when does synthetic augmentation actually help, and how many synthetic samples should be generated? We develop a unified statistical framework for synthetic augmentation in imbalanced learning, studying models trained on imbalanced data augmented with synthetic minority samples. Our theory shows that synthetic data is not always beneficial. In a "local symmetry" regime, imbalance is not the dominant source of error, so adding synthetic samples cannot improve learning rates and can even degrade performance by amplifying generator mismatch. When augmentation can help ("local asymmetry"), the optimal synthetic size depends on generator accuracy and on whether the generator's residual mismatch is directionally aligned with the intrinsic majority-minority shift. This structure can make the best synthetic size deviate from naive full balancing. Practically, we recommend Validation-Tuned Synthetic Size (VTSS): select the synthetic size by minimizing balanced validation loss over a range centered near the fully balanced baseline, while allowing meaningful departures. Extensive simulations and real data analysis further support our findings.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
When Does Synthetic Data Augmentation Improve Score-Based Imbalanced Classification?
Synthetic data augmentation is widely used to mitigate class imbalance, but its theoretical effects on score-based classification remain poorly understood. This paper develops a framework for characterizing when syntheti…
Data AugmentationAugmented Balanced Image Dataset Generator Using AugStatic Library
The mixed data consists of various structured and unstructured data. The exponential boom of the amount of data has made the datasets of varying samples. This paper focuses on the image dataset generator that balances an…
ClassificationData AugmentationData VisualizationDetecting Image Manipulation+13ChessMix: Spatial Context Data Augmentation for Remote Sensing Semantic Segmentation
Labeling semantic segmentation datasets is a costly and laborious process if compared with tasks like image classification and object detection. This is especially true for remote sensing applications that not only work …
Data Augmentationimage-classificationImage Classificationobject-detection+3Medical Image Synthesis for Data Augmentation and Anonymization using Generative Adversarial Networks
Data diversity is critical to success when training deep learning models. Medical imaging data sets are often imbalanced as pathologic findings are generally rare, which introduces significant challenges when training de…
Data AugmentationDiversityGenerative Adversarial NetworkImage Generation+3When Noisy Labels Meet Class Imbalance on Graphs: A Graph Augmentation Method with LLM and Pseudo Label
Class-imbalanced graph node classification is a practical yet underexplored research problem. Although recent studies have attempted to address this issue, they typically assume clean and reliable labels when processing …
Node Classification