Source-Free Open Compound Domain Adaptation in Semantic Segmentation
In this work, we introduce a new concept, named source-free open compound domain adaptation (SF-OCDA), and study it in semantic segmentation. SF-OCDA is more challenging than the traditional domain adaptation but it is more practical. It jointly considers (1) the issues of data privacy and data storage and (2) the scenario of multiple target domains and unseen open domains. In SF-OCDA, only the source pre-trained model and the target data are available to learn the target model. The model is evaluated on the samples from the target and unseen open domains. To solve this problem, we present an effective framework by separating the training process into two stages: (1) pre-training a generalized source model and (2) adapting a target model with self-supervised learning. In our framework, we propose the Cross-Patch Style Swap (CPSS) to diversify samples with various patch styles in the feature-level, which can benefit the training of both stages. First, CPSS can significantly improve the generalization ability of the source model, providing more accurate pseudo-labels for the latter stage. Second, CPSS can reduce the influence of noisy pseudo-labels and also avoid the model overfitting to the target domain during self-supervised learning, consistently boosting the performance on the target and open domains. Experiments demonstrate that our method produces state-of-the-art results on the C-Driving dataset. Furthermore, our model also achieves the leading performance on CityScapes for domain generalization.
Code (1)
Tasks
Domain AdaptationDomain GeneralizationSelf-Supervised LearningSemantic SegmentationSimilar Papers 제목 키워드 기반
AH-OCDA: Amplitude-based Curriculum Learning and Hopfield Segmentation Model for Open Compound Domain Adaptation
Open compound domain adaptation (OCDA) is a practical domain adaptation problem that consists of a source domain, target compound domain, and unseen open domain. In this problem, the absence of domain labels and pixel-le…
Domain AdaptationSegmentationSemantic SegmentationAmplitude Spectrum Transformation for Open Compound Domain Adaptive Semantic Segmentation
Open compound domain adaptation (OCDA) has emerged as a practical adaptation setting which considers a single labeled source domain against a compound of multi-modal unlabeled target data in order to generalize better on…
DisentanglementDomain AdaptationScene SegmentationSemantic SegmentationSCMix: Stochastic Compound Mixing for Open Compound Domain Adaptation in Semantic Segmentation
Open compound domain adaptation (OCDA) aims to transfer knowledge from a labeled source domain to a mix of unlabeled homogeneous compound target domains while generalizing to open unseen domains. Existing OCDA methods so…
Domain AdaptationSemantic SegmentationOpen Compound Domain Adaptation
A typical domain adaptation approach is to adapt models trained on the annotated data in a source domain (e.g., sunny weather) for achieving high performance on the test data in a target domain (e.g., rainy weather). Whe…
Domain AdaptationFacial Expression RecognitionFacial Expression Recognition (FER)Reinforcement Learning+1Discover, Hallucinate, and Adapt: Open Compound Domain Adaptation for Semantic Segmentation
Unsupervised domain adaptation (UDA) for semantic segmentation has been attracting attention recently, as it could be beneficial for various label-scarce real-world scenarios (e.g., robot control, autonomous driving, med…
Autonomous DrivingDomain AdaptationSemantic SegmentationTranslation+1