Cross-domain Self-supervised Learning for Domain Adaptation with Few Source Labels
Existing unsupervised domain adaptation methods aim to transfer knowledge from a label-rich source domain to an unlabeled target domain. However, obtaining labels for some source domains may be very expensive, making complete labeling as used in prior work impractical. In this work, we investigate a new domain adaptation scenario with sparsely labeled source data, where only a few examples in the source domain have been labeled, while the target domain is unlabeled. We show that when labeled source examples are limited, existing methods often fail to learn discriminative features applicable for both source and target domains. We propose a novel Cross-Domain Self-supervised (CDS) learning approach for domain adaptation, which learns features that are not only domain-invariant but also class-discriminative. Our self-supervised learning method captures apparent visual similarity with in-domain self-supervision in a domain adaptive manner and performs cross-domain feature matching with across-domain self-supervision. In extensive experiments with three standard benchmark datasets, our method significantly boosts performance of target accuracy in the new target domain with few source labels and is even helpful on classical domain adaptation scenarios.
Code (0)
등록된 구현이 없습니다.
Tasks
Domain AdaptationSelf-Supervised LearningUnsupervised Domain AdaptationSimilar Papers 제목 키워드 기반
Prototypical Cross-domain Self-supervised Learning for Few-shot Unsupervised Domain Adaptation
Unsupervised Domain Adaptation (UDA) transfers predictive models from a fully-labeled source domain to an unlabeled target domain. In some applications, however, it is expensive even to collect labels in the source domai…
Contrastive LearningDomain AdaptationSelf-Supervised LearningSemantic Segmentation+1Gradual Domain Adaptation via Self-Training of Auxiliary Models
Domain adaptation becomes more challenging with increasing gaps between source and target domains. Motivated from an empirical analysis on the reliability of labeled source data for the use of distancing target domains, …
Domain AdaptationSemi-supervised Domain AdaptationUnsupervised Video Domain Adaptation with Masked Pre-Training and Collaborative Self-Training
In this work, we tackle the problem of unsupervised domain adaptation (UDA) for video action recognition. Our approach, which we call UNITE, uses an image teacher model to adapt a video student model to the target domain…
Action RecognitionDomain AdaptationTemporal Action LocalizationUnsupervised Domain AdaptationSelf-Supervised Visual Prompting for Cross-Domain Road Damage Detection
The deployment of automated pavement defect detection is often hindered by poor cross-domain generalization. Supervised detectors achieve strong in-domain accuracy but require costly re-annotation for new environments, w…
Domain GeneralizationRoad Damage DetectionSelf-supervised Domain Adaptation for Computer Vision Tasks
Recent progress of self-supervised visual representation learning has achieved remarkable success on many challenging computer vision benchmarks. However, whether these techniques can be used for domain adaptation has no…
Domain AdaptationObject RecognitionRepresentation LearningSegmentation+1