Domain Generalization with MixStyle
Though convolutional neural networks (CNNs) have demonstrated remarkable ability in learning discriminative features, they often generalize poorly to unseen domains. Domain generalization aims to address this problem by learning from a set of source domains a model that is generalizable to any unseen domain. In this paper, a novel approach is proposed based on probabilistically mixing instance-level feature statistics of training samples across source domains. Our method, termed MixStyle, is motivated by the observation that visual domain is closely related to image style (e.g., photo vs.~sketch images). Such style information is captured by the bottom layers of a CNN where our proposed style-mixing takes place. Mixing styles of training instances results in novel domains being synthesized implicitly, which increase the domain diversity of the source domains, and hence the generalizability of the trained model. MixStyle fits into mini-batch training perfectly and is extremely easy to implement. The effectiveness of MixStyle is demonstrated on a wide range of tasks including category classification, instance retrieval and reinforcement learning.
Code (3)
Tasks
DiversityDomain GeneralizationRetrievalSimilar Papers 제목 키워드 기반
MixStyle Neural Networks for Domain Generalization and Adaptation
Neural networks do not generalize well to unseen data with domain shifts -- a longstanding problem in machine learning and AI. To overcome the problem, we propose MixStyle, a simple plug-and-play, parameter-free module t…
Data AugmentationDomain AdaptationDomain GeneralizationObject Recognition+5Mixstyle based Domain Generalization for Sound Event Detection with Heterogeneous Training Data
This work explores domain generalization (DG) for sound event detection (SED), advancing adaptability towards real-world scenarios. Our approach employs a mean-teacher framework with domain generalization to integrate he…
Domain GeneralizationEvent DetectionSound Event DetectionFace Presentation Attack Detection by Excavating Causal Clues and Adapting Embedding Statistics
Recent face presentation attack detection (PAD) leverages domain adaptation (DA) and domain generalization (DG) techniques to address performance degradation on unknown domains. However, DA-based PAD methods require acce…
counterfactualDomain AdaptationDomain GeneralizationFace Presentation Attack Detection+1Higher-Order Domain Generalization in Magnetic Resonance-Based Assessment of Alzheimer's Disease
Despite progress in deep learning for Alzheimer's disease (AD) diagnostics, models trained on structural magnetic resonance imaging (sMRI) often do not perform well when applied to new cohorts due to domain shifts from v…
Domain GeneralizationDevice-Robust Acoustic Scene Classification via Impulse Response Augmentation
The ability to generalize to a wide range of recording devices is a crucial performance factor for audio classification models. The characteristics of different types of microphones introduce distributional shifts in the…
Acoustic Scene ClassificationAudio ClassificationClassificationDiversity+1