Anti-causal domain generalization: Leveraging unlabeled data
The problem of domain generalization concerns learning predictive models that are robust to distribution shifts when deployed in new, previously unseen environments. Existing methods typically require labeled data from multiple training environments, limiting their applicability when labeled data are scarce. In this work, we study domain generalization in an anti-causal setting, where the outcome causes the observed covariates. Under this structure, environment perturbations that affect the covariates do not propagate to the outcome, which motivates regularizing the model's sensitivity to these perturbations. Crucially, estimating these perturbation directions does not require labels, enabling us to leverage unlabeled data from multiple environments. We propose two methods that penalize the model's sensitivity to variations in the mean and covariance of the covariates across environments, respectively, and prove that these methods have worst-case optimality guarantees under certain classes of environments. Finally, we demonstrate the empirical performance of our approach on a controlled physical system and a physiological signal dataset.
Code (0)
등록된 구현이 없습니다.
Tasks
Domain GeneralizationSimilar Papers 제목 키워드 기반
Causal Prototype-inspired Contrast Adaptation for Unsupervised Domain Adaptive Semantic Segmentation of High-resolution Remote Sensing Imagery
Semantic segmentation of high-resolution remote sensing imagery (HRSI) suffers from the domain shift, resulting in poor performance of the model in another unseen domain. Unsupervised domain adaptive (UDA) semantic segme…
counterfactualDisentanglementSegmentationSemantic SegmentationSparse Causal Discovery with Generative Intervention for Unsupervised Graph Domain Adaptation
Unsupervised Graph Domain Adaptation (UGDA) leverages labeled source domain graphs to achieve effective performance in unlabeled target domains despite distribution shifts. However, existing methods often yield suboptima…
GRAPH DOMAIN ADAPTATIONDaSeGAN: Domain Adaptation for Segmentation Tasks via Generative Adversarial Networks
A weakness of deep learning methods is that they can fail when there is a mismatch between source and target data domains. In medical image applications, this is a common situation when data from new vendor devices or di…
Domain AdaptationDomain GeneralizationImage SegmentationMulti-Source Unsupervised Domain Adaptation+2Chaos Is a LADDER: Domain Generalization Beyond Invariance via Reweighting
Domain generalization (DG) aims to learn from multiple source domains and generalize to unseen target domains. Most DG methods pursue invariance: they seek a causal representation whose prediction rule is invariant acros…
Domain GeneralizationDIGIC: Domain Generalizable Imitation Learning by Causal Discovery
Causality has been combined with machine learning to produce robust representations for domain generalization. Most existing methods of this type require massive data from multiple domains to identify causal features by …
Causal DiscoveryDomain GeneralizationImitation Learning