Cross-domain Contrastive Learning for Unsupervised Domain Adaptation
Unsupervised domain adaptation (UDA) aims to transfer knowledge learned from a fully-labeled source domain to a different unlabeled target domain. Most existing UDA methods learn domain-invariant feature representations by minimizing feature distances across domains. In this work, we build upon contrastive self-supervised learning to align features so as to reduce the domain discrepancy between training and testing sets. Exploring the same set of categories shared by both domains, we introduce a simple yet effective framework CDCL, for domain alignment. In particular, given an anchor image from one domain, we minimize its distances to cross-domain samples from the same class relative to those from different categories. Since target labels are unavailable, we use a clustering-based approach with carefully initialized centers to produce pseudo labels. In addition, we demonstrate that CDCL is a general framework and can be adapted to the data-free setting, where the source data are unavailable during training, with minimal modification. We conduct experiments on two widely used domain adaptation benchmarks, i.e., Office-31 and VisDA-2017, for image classification tasks, and demonstrate that CDCL achieves state-of-the-art performance on both datasets.
Code (1)
Tasks
ClusteringContrastive LearningDomain Adaptationimage-classificationImage ClassificationSelf-Supervised LearningUnsupervised Domain AdaptationSimilar Papers 제목 키워드 기반
Unsupervised Contrastive Domain Adaptation for Semantic Segmentation
Semantic segmentation models struggle to generalize in the presence of domain shift. In this paper, we introduce contrastive learning for feature alignment in cross-domain adaptation. We assemble both in-domain contrasti…
Contrastive LearningDomain AdaptationSemantic SegmentationContrast and Mix: Temporal Contrastive Video Domain Adaptation with Background Mixing
Unsupervised domain adaptation which aims to adapt models trained on a labeled source domain to a completely unlabeled target domain has attracted much attention in recent years. While many domain adaptation techniques h…
Contrastive LearningDomain AdaptationUnsupervised Domain AdaptationVideo Domain AdapationDomain Confused Contrastive Learning for Unsupervised Domain Adaptation
In this work, we study Unsupervised Domain Adaptation (UDA) in a challenging self-supervised approach. One of the difficulties is how to learn task discrimination in the absence of target labels. Unlike previous literatu…
Contrastive LearningDomain AdaptationUnsupervised Domain AdaptationModel Adaptation: Historical Contrastive Learning for Unsupervised Domain Adaptation without Source Data
Unsupervised domain adaptation aims to align a labeled source domain and an unlabeled target domain, but it requires to access the source data which often raises concerns in data privacy, data portability and data transm…
Contrastive LearningDomain AdaptationSource Free Object DetectionUnsupervised Domain AdaptationDomain Adaptation for Semantic Segmentation via Patch-Wise Contrastive Learning
We introduce a novel approach to unsupervised and semi-supervised domain adaptation for semantic segmentation. Unlike many earlier methods that rely on adversarial learning for feature alignment, we leverage contrastive …
Contrastive LearningDomain AdaptationSegmentationSemantic Segmentation+1