COD: Learning Conditional Invariant Representation for Domain Adaptation Regression
Aiming to generalize the label knowledge from a source domain with continuous outputs to an unlabeled target domain, Domain Adaptation Regression (DAR) is developed for complex practical learning problems. However, due to the continuity problem in regression, existing conditional distribution alignment theory and methods with discrete prior, which are proven to be effective in classification settings, are no longer applicable. In this work, focusing on the feasibility problems in DAR, we establish the sufficiency theory for the regression model, which shows the generalization error can be sufficiently dominated by the cross-domain conditional discrepancy. Further, to characterize conditional discrepancy with continuous conditioning variable, a novel Conditional Operator Discrepancy (COD) is proposed, which admits the metric property on conditional distributions via the kernel embedding theory. Finally, to minimize the discrepancy, a COD-based conditional invariant representation learning model is proposed, and the reformulation is derived to show that reasonable modifications on moment statistics can further improve the discriminability of the adaptation model. Extensive experiments on standard DAR datasets verify the validity of theoretical results and the superiority over SOTA DAR methods.
Code (0)
등록된 구현이 없습니다.
Tasks
Domain AdaptationregressionRepresentation LearningSimilar Papers 제목 키워드 기반
Learning Invariant Representations and Risks for Semi-supervised Domain Adaptation
The success of supervised learning hinges on the assumption that the training and test data come from the same underlying distribution, which is often not valid in practice due to potential distribution shift. In light o…
Domain AdaptationregressionSemi-supervised Domain AdaptationUnsupervised Domain Adaptation+1On Learning Invariant Representation for Domain Adaptation
Due to the ability of deep neural nets to learn rich representations, recent advances in unsupervised domain adaptation have focused on learning domain-invariant features that achieve a small error on the source domain. …
Domain AdaptationRepresentation LearningUnsupervised Domain AdaptationLabel-Noise Robust Domain Adaptation
Domain adaptation aims to correct the classifiers when faced with distribution shift between source (training) and target (test) domains. State-of-the-art domain adaptation methods make use of deep networks to extract do…
DenoisingDomain AdaptationDomain Adaptation with Invariant Representation Learning: What Transformations to Learn?
Unsupervised domain adaptation, as a prevalent transfer learning setting, spans many real-world applications. With the increasing representational power and applicability of neural networks, state-of-the-art domain adapt…
Domain AdaptationRepresentation LearningTransfer LearningUnsupervised Domain AdaptationCausal Domain Adaptation with Copula Entropy based Conditional Independence Test
Domain Adaptation (DA) is a typical problem in machine learning that aims to transfer the model trained on source domain to target domain with different distribution. Causal DA is a special case of DA that solves the pro…
Causal DiscoveryDomain Adaptation