Deep causal representation learning for unsupervised domain adaptation
Studies show that the representations learned by deep neural networks can be transferred to similar prediction tasks in other domains for which we do not have enough labeled data. However, as we transition to higher layers in the model, the representations become more task-specific and less generalizable. Recent research on deep domain adaptation proposed to mitigate this problem by forcing the deep model to learn more transferable feature representations across domains. This is achieved by incorporating domain adaptation methods into deep learning pipeline. The majority of existing models learn the transferable feature representations which are highly correlated with the outcome. However, correlations are not always transferable. In this paper, we propose a novel deep causal representation learning framework for unsupervised domain adaptation, in which we propose to learn domain-invariant causal representations of the input from the source domain. We simulate a virtual target domain using reweighted samples from the source domain and estimate the causal effect of features on the outcomes. The extensive comparative study demonstrates the strengths of the proposed model for unsupervised domain adaptation via causal representations.
Code (0)
등록된 구현이 없습니다.
Tasks
Domain AdaptationRepresentation LearningUnsupervised Domain AdaptationSimilar Papers 제목 키워드 기반
Transporting Causal Mechanisms for Unsupervised Domain Adaptation
Existing Unsupervised Domain Adaptation (UDA) literature adopts the covariate shift and conditional shift assumptions, which essentially encourage models to learn common features across domains. However, due to the lack …
Domain AdaptationUnsupervised Domain AdaptationSparse Causal Discovery with Generative Intervention for Unsupervised Graph Domain Adaptation
Unsupervised Graph Domain Adaptation (UGDA) leverages labeled source domain graphs to achieve effective performance in unlabeled target domains despite distribution shifts. However, existing methods often yield suboptima…
GRAPH DOMAIN ADAPTATIONCausal Discovery Inspired Unsupervised Domain Adaptation for Emotion-Cause Pair Extraction
This paper tackles the task of emotion-cause pair extraction in the unsupervised domain adaptation setting. The problem is challenging as the distributions of the events causing emotions in target domains are dramaticall…
Causal DiscoveryDomain AdaptationEmotion-Cause Pair ExtractionTransfer Learning+1Learning causal representations for robust domain adaptation
Domain adaptation solves the learning problem in a target domain by leveraging the knowledge in a relevant source domain. While remarkable advances have been made, almost all existing domain adaptation methods heavily re…
Domain AdaptationCausal Prototype-inspired Contrast Adaptation for Unsupervised Domain Adaptive Semantic Segmentation of High-resolution Remote Sensing Imagery
Semantic segmentation of high-resolution remote sensing imagery (HRSI) suffers from the domain shift, resulting in poor performance of the model in another unseen domain. Unsupervised domain adaptive (UDA) semantic segme…
counterfactualDisentanglementSegmentationSemantic Segmentation