paper-with-me

Papers

Multi-Source domain adaptation via supervised contrastive learning and confident consistency regularization

2021-06-30 · Marin Scalbert, Maria Vakalopoulou, Florent Couzinié-Devy

Multi-Source Unsupervised Domain Adaptation (multi-source UDA) aims to learn a model from several labeled source domains while performing well on a different target domain where only unlabeled data are available at training time. To align source and target features distributions, several recent works use source and target explicit statistics matching such as features moments or class centroids. Yet, these approaches do not guarantee class conditional distributions alignment across domains. In this work, we propose a new framework called Contrastive Multi-Source Domain Adaptation (CMSDA) for multi-source UDA that addresses this limitation. Discriminative features are learned from interpolated source examples via cross entropy minimization and from target examples via consistency regularization and hard pseudo-labeling. Simultaneously, interpolated source examples are leveraged to align source class conditional distributions through an interpolated version of the supervised contrastive loss. This alignment leads to more general and transferable features which further improves the generalization on the target domain. Extensive experiments have been carried out on three standard multi-source UDA datasets where our method reports state-of-the-art results.

📄 PDF Abstract BibTeX arXiv:2106.16093

Code (0)

등록된 구현이 없습니다.

Tasks

Contrastive LearningDomain AdaptationMulti-Source Unsupervised Domain AdaptationUnsupervised Domain Adaptation

Similar Papers 제목 키워드 기반

DACAD: Domain Adaptation Contrastive Learning for Anomaly Detection in Multivariate Time Series

2024-04-17 · Zahra Zamanzadeh Darban, Yiyuan Yang, Geoffrey I. Webb, Charu C. Aggarwal 외

In time series anomaly detection (TSAD), the scarcity of labeled data poses a challenge to the development of accurate models. Unsupervised domain adaptation (UDA) offers a solution by leveraging labeled data from a rela…

Anomaly DetectionContrastive LearningDomain AdaptationRepresentation Learning+4

CLDA: Contrastive Learning for Semi-Supervised Domain Adaptation

2021-06-30 · NeurIPS 2021 12 · Ankit Singh

Unsupervised Domain Adaptation (UDA) aims to align the labeled source distribution with the unlabeled target distribution to obtain domain invariant predictive models. However, the application of well-known UDA approache…

Contrastive LearningDomain AdaptationSemi-supervised Domain AdaptationUnsupervised Domain Adaptation

QA Domain Adaptation using Hidden Space Augmentation and Self-Supervised Contrastive Adaptation

2022-10-19 · Zhenrui Yue, Huimin Zeng, Bernhard Kratzwald, Stefan Feuerriegel 외

Question answering (QA) has recently shown impressive results for answering questions from customized domains. Yet, a common challenge is to adapt QA models to an unseen target domain. In this paper, we propose a novel s…

Contrastive LearningData AugmentationDomain AdaptationQuestion Answering

Model Adaptation: Historical Contrastive Learning for Unsupervised Domain Adaptation without Source Data

2021-10-07 · NeurIPS 2021 12 · Jiaxing Huang, Dayan Guan, Aoran Xiao, Shijian Lu

Unsupervised domain adaptation aims to align a labeled source domain and an unlabeled target domain, but it requires to access the source data which often raises concerns in data privacy, data portability and data transm…

Contrastive LearningDomain AdaptationSource Free Object DetectionUnsupervised Domain Adaptation

Transferrable Contrastive Learning for Visual Domain Adaptation

2021-12-14 · Yang Chen, Yingwei Pan, Yu Wang, Ting Yao 외

Self-supervised learning (SSL) has recently become the favorite among feature learning methodologies. It is therefore appealing for domain adaptation approaches to consider incorporating SSL. The intuition is to enforce …

Contrastive LearningDomain AdaptationPseudo LabelSelf-Supervised Learning