CDA: Contrastive-adversarial Domain Adaptation
Recent advances in domain adaptation reveal that adversarial learning on deep neural networks can learn domain invariant features to reduce the shift between source and target domains. While such adversarial approaches achieve domain-level alignment, they ignore the class (label) shift. When class-conditional data distributions are significantly different between the source and target domain, it can generate ambiguous features near class boundaries that are more likely to be misclassified. In this work, we propose a two-stage model for domain adaptation called \textbf{C}ontrastive-adversarial \textbf{D}omain \textbf{A}daptation \textbf{(CDA)}. While the adversarial component facilitates domain-level alignment, two-stage contrastive learning exploits class information to achieve higher intra-class compactness across domains resulting in well-separated decision boundaries. Furthermore, the proposed contrastive framework is designed as a plug-and-play module that can be easily embedded with existing adversarial methods for domain adaptation. We conduct experiments on two widely used benchmark datasets for domain adaptation, namely, \textit{Office-31} and \textit{Digits-5}, and demonstrate that CDA achieves state-of-the-art results on both datasets.
Code (0)
등록된 구현이 없습니다.
Tasks
Contrastive LearningDomain AdaptationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Self-degraded contrastive domain adaptation for industrial fault diagnosis with bi-imbalanced data
Modern industrial fault diagnosis tasks often face the combined challenge of distribution discrepancy and bi-imbalance. Existing domain adaptation approaches pay little attention to the prevailing bi-imbalance, leading t…
Contrastive LearningDomain AdaptationFault DiagnosisRobustified Domain Adaptation
Unsupervised domain adaptation (UDA) is widely used to transfer knowledge from a labeled source domain to an unlabeled target domain with different data distribution. While extensive studies attested that deep learning m…
Adversarial RobustnessDomain AdaptationUnsupervised Domain AdaptationCALDA: Improving Multi-Source Time Series Domain Adaptation with Contrastive Adversarial Learning
Unsupervised domain adaptation (UDA) provides a strategy for improving machine learning performance in data-rich (target) domains where ground truth labels are inaccessible but can be found in related (source) domains. I…
Activity RecognitionContrastive LearningData AugmentationDomain Adaptation+4Contrast and Mix: Temporal Contrastive Video Domain Adaptation with Background Mixing
Unsupervised domain adaptation which aims to adapt models trained on a labeled source domain to a completely unlabeled target domain has attracted much attention in recent years. While many domain adaptation techniques h…
Contrastive LearningDomain AdaptationUnsupervised Domain AdaptationVideo Domain AdapationDomain Adaptation for Semantic Segmentation via Patch-Wise Contrastive Learning
We introduce a novel approach to unsupervised and semi-supervised domain adaptation for semantic segmentation. Unlike many earlier methods that rely on adversarial learning for feature alignment, we leverage contrastive …
Contrastive LearningDomain AdaptationSegmentationSemantic Segmentation+1