Domain-wise Adversarial Training for Out-of-Distribution Generalization
Despite the impressive success on many tasks, deep learning models are shown to rely on spurious features, which will catastrophically fail when generalized to out-of-distribution (OOD) data. To alleviate this issue, Invariant Risk Minimization (IRM) is proposed to extract domain-invariant features for OOD generalization. Nevertheless, recent work shows that IRM is only effective for a certain type of distribution shift (e.g., correlation shift) while fails for other cases (e.g., diversity shift). Meanwhile, another thread of method, Adversarial Training (AT), has shown better domain transfer performance, suggesting that it is potential to be an effective candidate for extracting domain-invariant features. In this paper, we investigate this possibility by exploring the similarity between the IRM and AT objectives. Inspired by this connection, we propose Domain-wise Adversarial Training (DAT), an AT-inspired method for alleviating distribution shift by domain-specific perturbations. Extensive experiments show that our proposed DAT can effectively remove the domain-varying features and improve OOD generalization on both correlation shift and diversity shift tasks.
Code (0)
등록된 구현이 없습니다.
Tasks
DiversityOut-of-Distribution GeneralizationSimilar Papers 제목 키워드 기반
Improving Out-of-Distribution Generalization by Adversarial Training with Structured Priors
Deep models often fail to generalize well in test domains when the data distribution differs from that in the training domain. Among numerous approaches to address this Out-of-Distribution (OOD) generalization problem, t…
Out-of-Distribution GeneralizationOn the Connection between Invariant Learning and Adversarial Training for Out-of-Distribution Generalization
Despite impressive success in many tasks, deep learning models are shown to rely on spurious features, which will catastrophically fail when generalized to out-of-distribution (OOD) data. Invariant Risk Minimization (IRM…
DiversityOut-of-Distribution GeneralizationSingle Domain Generalization with Adversarial Memory
Domain Generalization (DG) aims to train models that can generalize to unseen testing domains by leveraging data from multiple training domains. However, traditional DG methods rely on the availability of multiple divers…
DiversityDomain GeneralizationDual Distribution Alignment Network for Generalizable Person Re-Identification
Domain generalization (DG) serves as a promising solution to handle person Re-Identification (Re-ID), which trains the model using labels from the source domain alone, and then directly adopts the trained model to the ta…
Domain GeneralizationGeneralizable Person Re-identificationPerson Re-IdentificationMultisource Collaborative Domain Generalization for Cross-Scene Remote Sensing Image Classification
Cross-scene image classification aims to transfer prior knowledge of ground materials to annotate regions with different distributions and reduce hand-crafted cost in the field of remote sensing. However, existing approa…
DiversityDomain Generalizationimage-classificationImage Classification+3