Joint Contrastive Learning for Unsupervised Domain Adaptation
Enhancing feature transferability by matching marginal distributions has led to improvements in domain adaptation, although this is at the expense of feature discrimination. In particular, the ideal joint hypothesis error in the target error upper bound, which was previously considered to be minute, has been found to be significant, impairing its theoretical guarantee. In this paper, we propose an alternative upper bound on the target error that explicitly considers the joint error to render it more manageable. With the theoretical analysis, we suggest a joint optimization framework that combines the source and target domains. Further, we introduce Joint Contrastive Learning (JCL) to find class-level discriminative features, which is essential for minimizing the joint error. With a solid theoretical framework, JCL employs contrastive loss to maximize the mutual information between a feature and its label, which is equivalent to maximizing the Jensen-Shannon divergence between conditional distributions. Experiments on two real-world datasets demonstrate that JCL outperforms the state-of-the-art methods.
Code (1)
Tasks
Contrastive LearningDomain AdaptationUnsupervised Domain AdaptationSimilar Papers 제목 키워드 기반
Joint Generative and Contrastive Learning for Unsupervised Person Re-identification
Recent self-supervised contrastive learning provides an effective approach for unsupervised person re-identification (ReID) by learning invariance from different views (transformed versions) of an input. In this paper, w…
Contrastive LearningData AugmentationDomain AdaptationGenerative Adversarial Network+3Cross-View Cross-Modal Unsupervised Domain Adaptation for Driver Monitoring System
Driver distraction remains a leading cause of road traffic accidents, contributing to thousands of fatalities annually across the globe. While deep learning-based driver activity recognition methods have shown promise in…
Unsupervised Domain AdaptationContrastive LearningActivity RecognitionContrast and Mix: Temporal Contrastive Video Domain Adaptation with Background Mixing
Unsupervised domain adaptation which aims to adapt models trained on a labeled source domain to a completely unlabeled target domain has attracted much attention in recent years. While many domain adaptation techniques h…
Contrastive LearningDomain AdaptationUnsupervised Domain AdaptationVideo Domain AdapationMargin Preserving Self-paced Contrastive Learning Towards Domain Adaptation for Medical Image Segmentation
To bridge the gap between the source and target domains in unsupervised domain adaptation (UDA), the most common strategy puts focus on matching the marginal distributions in the feature space through adversarial learnin…
Cardiac SegmentationContrastive LearningDomain AdaptationImage Segmentation+4Spatio-temporal Contrastive Domain Adaptation for Action Recognition
Unsupervised domain adaptation (UDA) for human action recognition is a practical and challenging problem. Compared with image-based UDA, video-based UDA is comprehensive to bridge the domain shift on both spatial rep…
Action RecognitionContrastive LearningDomain AdaptationSelf-Supervised Learning+2