Generalization Gap in Data Augmentation: Insights from Illumination
In the field of computer vision, data augmentation is widely used to enrich the feature complexity of training datasets with deep learning techniques. However, regarding the generalization capabilities of models, the difference in artificial features generated by data augmentation and natural visual features has not been fully revealed. This study introduces the concept of "visual representation variables" to define the possible visual variations in a task as a joint distribution of these variables. We focus on the visual representation variable "illumination", by simulating its distribution degradation and examining how data augmentation techniques enhance model performance on a classification task. Our goal is to investigate the differences in generalization between models trained with augmented data and those trained under real-world illumination conditions. Results indicate that after applying various data augmentation methods, model performance has significantly improved. Yet, a noticeable generalization gap still exists after utilizing various data augmentation methods, emphasizing the critical role of feature diversity in the training set for enhancing model generalization.
Code (0)
등록된 구현이 없습니다.
Tasks
Data AugmentationDiversityMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
CAD-Free Learning of Spacecraft Pose Estimators via NeRF-Based Augmentations
Spacecraft pose estimation networks require tens of thousands of CAD-rendered images to be trained. This reliance on synthetic CAD data (i) limits applicability to targets with reliable geometry prior, excluding uncooper…
Domain GeneralizationImage AugmentationPose EstimationControllable Data Augmentation Through Deep Relighting
At the heart of the success of deep learning is the quality of the data. Through data augmentation, one can train models with better generalization capabilities and thus achieve greater results in their field of interest…
Data AugmentationDecoderDomain Generalization for 6D Pose Estimation Through NeRF-based Image Synthesis
This work introduces a novel augmentation method that increases the diversity of a train set to improve the generalization abilities of a 6D pose estimation network. For this purpose, a Neural Radiance Field is trained f…
6D Pose EstimationDiversityDomain GeneralizationImage Generation+3Illumination-Based Data Augmentation for Robust Background Subtraction
A core challenge in background subtraction (BGS) is handling videos with sudden illumination changes in consecutive frames. In this paper, we tackle the problem from a data point-of-view using data augmentation. Our meth…
Data AugmentationForeground SegmentationVideo Background SubtractionVideo Object SegmentationTest-time image-to-image translation ensembling improves out-of-distribution generalization in histopathology
Histopathology whole slide images (WSIs) can reveal significant inter-hospital variability such as illumination, color or optical artifacts. These variations, caused by the use of different scanning protocols across medi…
ArticlesData AugmentationDomain GeneralizationImage-to-Image Translation+3