Multi-Source domain adaptation via supervised contrastive learning and confident consistency regularization
Multi-Source Unsupervised Domain Adaptation (multi-source UDA) aims to learn a model from several labeled source domains while performing well on a different target domain where only unlabeled data are available at training time. To align source and target features distributions, several recent works use source and target explicit statistics matching such as features moments or class centroids. Yet, these approaches do not guarantee class conditional distributions alignment across domains. In this work, we propose a new framework called Contrastive Multi-Source Domain Adaptation (CMSDA) for multi-source UDA that addresses this limitation. Discriminative features are learned from interpolated source examples via cross entropy minimization and from target examples via consistency regularization and hard pseudo-labeling. Simultaneously, interpolated source examples are leveraged to align source class conditional distributions through an interpolated version of the supervised contrastive loss. This alignment leads to more general and transferable features which further improves the generalization on the target domain. Extensive experiments have been carried out on three standard multi-source UDA datasets where our method reports state-of-the-art results.
Code (0)
등록된 구현이 없습니다.
Tasks
Contrastive LearningDomain AdaptationMulti-Source Unsupervised Domain AdaptationUnsupervised Domain AdaptationSimilar Papers 제목 키워드 기반
DACAD: Domain Adaptation Contrastive Learning for Anomaly Detection in Multivariate Time Series
In time series anomaly detection (TSAD), the scarcity of labeled data poses a challenge to the development of accurate models. Unsupervised domain adaptation (UDA) offers a solution by leveraging labeled data from a rela…
Anomaly DetectionContrastive LearningDomain AdaptationRepresentation Learning+4CLDA: Contrastive Learning for Semi-Supervised Domain Adaptation
Unsupervised Domain Adaptation (UDA) aims to align the labeled source distribution with the unlabeled target distribution to obtain domain invariant predictive models. However, the application of well-known UDA approache…
Contrastive LearningDomain AdaptationSemi-supervised Domain AdaptationUnsupervised Domain AdaptationQA Domain Adaptation using Hidden Space Augmentation and Self-Supervised Contrastive Adaptation
Question answering (QA) has recently shown impressive results for answering questions from customized domains. Yet, a common challenge is to adapt QA models to an unseen target domain. In this paper, we propose a novel s…
Contrastive LearningData AugmentationDomain AdaptationQuestion AnsweringModel Adaptation: Historical Contrastive Learning for Unsupervised Domain Adaptation without Source Data
Unsupervised domain adaptation aims to align a labeled source domain and an unlabeled target domain, but it requires to access the source data which often raises concerns in data privacy, data portability and data transm…
Contrastive LearningDomain AdaptationSource Free Object DetectionUnsupervised Domain AdaptationTransferrable Contrastive Learning for Visual Domain Adaptation
Self-supervised learning (SSL) has recently become the favorite among feature learning methodologies. It is therefore appealing for domain adaptation approaches to consider incorporating SSL. The intuition is to enforce …
Contrastive LearningDomain AdaptationPseudo LabelSelf-Supervised Learning