Style Augmentation: Data Augmentation via Style Randomization
We introduce style augmentation, a new form of data augmentation based on random style transfer, for improving the robustness of convolutional neural networks (CNN) over both classification and regression based tasks. During training, our style augmentation randomizes texture, contrast and color, while preserving shape and semantic content. This is accomplished by adapting an arbitrary style transfer network to perform style randomization, by sampling input style embeddings from a multivariate normal distribution instead of inferring them from a style image. In addition to standard classification experiments, we investigate the effect of style augmentation (and data augmentation generally) on domain transfer tasks. We find that data augmentation significantly improves robustness to domain shift, and can be used as a simple, domain agnostic alternative to domain adaptation. Comparing style augmentation against a mix of seven traditional augmentation techniques, we find that it can be readily combined with them to improve network performance. We validate the efficacy of our technique with domain transfer experiments in classification and monocular depth estimation, illustrating consistent improvements in generalization.
Code (1)
Tasks
ClassificationData AugmentationDepth EstimationDomain AdaptationGeneral ClassificationMonocular Depth EstimationStyle TransferSimilar Papers 제목 키워드 기반
Feature-based Style Randomization for Domain Generalization
As a recent noticeable topic, domain generalization (DG) aims to first learn a generic model on multiple source domains and then directly generalize to an arbitrary unseen target domain without any additional adaption. I…
Data AugmentationDiversityDomain GeneralizationWSAM: Visual Explanations from Style Augmentation as Adversarial Attacker and Their Influence in Image Classification
Currently, style augmentation is capturing attention due to convolutional neural networks (CNN) being strongly biased toward recognizing textures rather than shapes. Most existing styling methods either perform a low-fid…
image-classificationImage ClassificationStyle TransferConStyX: Content Style Augmentation for Generalizable Medical Image Segmentation
Medical images are usually collected from multiple domains, leading to domain shifts that impair the performance of medical image segmentation models. Domain Generalization (DG) aims to address this issue by training a r…
Domain GeneralizationImage SegmentationMedical Image SegmentationSemantic SegmentationEvaluation of Randomization through Style Transfer for Enhanced Domain Generalization
Deep learning models for computer vision often suffer from poor generalization when deployed in real-world settings, especially when trained on synthetic data due to the well-known Sim2Real gap. Despite the growing popul…
Domain GeneralizationScene UnderstandingData AugmentationStyle TransferA Simple Recipe for Language-guided Domain Generalized Segmentation
Generalization to new domains not seen during training is one of the long-standing challenges in deploying neural networks in real-world applications. Existing generalization techniques either necessitate external images…
Data AugmentationSemantic Segmentation