PixMatch: Unsupervised Domain Adaptation via Pixelwise Consistency Training
Unsupervised domain adaptation is a promising technique for semantic segmentation and other computer vision tasks for which large-scale data annotation is costly and time-consuming. In semantic segmentation, it is attractive to train models on annotated images from a simulated (source) domain and deploy them on real (target) domains. In this work, we present a novel framework for unsupervised domain adaptation based on the notion of target-domain consistency training. Intuitively, our work is based on the idea that in order to perform well on the target domain, a model's output should be consistent with respect to small perturbations of inputs in the target domain. Specifically, we introduce a new loss term to enforce pixelwise consistency between the model's predictions on a target image and a perturbed version of the same image. In comparison to popular adversarial adaptation methods, our approach is simpler, easier to implement, and more memory-efficient during training. Experiments and extensive ablation studies demonstrate that our simple approach achieves remarkably strong results on two challenging synthetic-to-real benchmarks, GTA5-to-Cityscapes and SYNTHIA-to-Cityscapes. Code is available at: https://github.com/lukemelas/pixmatch
Code (1)
Tasks
Domain AdaptationSemantic SegmentationSynthetic-to-Real TranslationUnsupervised Domain AdaptationSimilar Papers 제목 키워드 기반
IPixMatch: Boost Semi-supervised Semantic Segmentation with Inter-Pixel Relation
The scarcity of labeled data in real-world scenarios is a critical bottleneck of deep learning's effectiveness. Semi-supervised semantic segmentation has been a typical solution to achieve a desirable tradeoff between an…
RelationSemantic SegmentationSemi-Supervised Semantic SegmentationDomain Consistency Regularization for Unsupervised Multi-source Domain Adaptive Classification
Deep learning-based multi-source unsupervised domain adaptation (MUDA) has been actively studied in recent years. Compared with single-source unsupervised domain adaptation (SUDA), domain shift in MUDA exists not only be…
ClassificationDomain AdaptationMulti-Source Unsupervised Domain AdaptationPseudo Label+1Adaptive Local Structure Consistency based Heterogeneous Remote Sensing Change Detection
Change detection of heterogeneous remote sensing images is an important and challenging topic in remote sensing for emergency situation resulting from nature disaster. Due to the different imaging mechanisms of heterogen…
Change DetectionUnsupervised Domain Adaptation via Disentangled Representations: Application to Cross-Modality Liver Segmentation
A deep learning model trained on some labeled data from a certain source domain generally performs poorly on data from different target domains due to domain shifts. Unsupervised domain adaptation methods address this pr…
Domain AdaptationImage GenerationLiver SegmentationSegmentation+2Preserving Semantic Consistency in Unsupervised Domain Adaptation Using Generative Adversarial Networks
Unsupervised domain adaptation seeks to mitigate the distribution discrepancy between source and target domains, given labeled samples of the source domain and unlabeled samples of the target domain. Generative adversari…
Domain AdaptationGenerative Adversarial NetworkUnsupervised Domain Adaptation