Learning to Adapt Structured Output Space for Semantic Segmentation
Convolutional neural network-based approaches for semantic segmentation rely on supervision with pixel-level ground truth, but may not generalize well to unseen image domains. As the labeling process is tedious and labor intensive, developing algorithms that can adapt source ground truth labels to the target domain is of great interest. In this paper, we propose an adversarial learning method for domain adaptation in the context of semantic segmentation. Considering semantic segmentations as structured outputs that contain spatial similarities between the source and target domains, we adopt adversarial learning in the output space. To further enhance the adapted model, we construct a multi-level adversarial network to effectively perform output space domain adaptation at different feature levels. Extensive experiments and ablation study are conducted under various domain adaptation settings, including synthetic-to-real and cross-city scenarios. We show that the proposed method performs favorably against the state-of-the-art methods in terms of accuracy and visual quality.
Code (12)
Tasks
Domain AdaptationImage-to-Image TranslationSegmentationSemantic SegmentationSynthetic-to-Real TranslationSimilar Papers 제목 키워드 기반
Affinity Space Adaptation for Semantic Segmentation Across Domains
Semantic segmentation with dense pixel-wise annotation has achieved excellent performance thanks to deep learning. However, the generalization of semantic segmentation in the wild remains challenging. In this paper, we a…
Domain AdaptationSegmentationSemantic SegmentationUnsupervised Domain AdaptationDomain Adaptation for Structured Output via Discriminative Patch Representations
Predicting structured outputs such as semantic segmentation relies on expensive per-pixel annotations to learn supervised models like convolutional neural networks. However, models trained on one data domain may not gene…
Domain AdaptationImage-to-Image TranslationSegmentationSemantic Segmentation+1Domain Adaptation for Structured Output via Disentangled Patch Representations
Predicting structured outputs such as semantic segmentation relies on expensive per-pixel annotations to learn strong supervised models like convolutional neural networks. However, these models trained on one data domain…
Domain AdaptationSemantic SegmentationExploring and Exploiting Diversity for Image Segmentation
Semantic image segmentation is an important computer vision task that is difficult because it consists of both recognition and segmentation. The task is often cast as a structured output problem on an exponentially large…
DiversityImage SegmentationRe-RankingSegmentation+1Domain Adaptive Semantic Segmentation by Optimal Transport
Scene segmentation is widely used in the field of autonomous driving for environment perception, and semantic scene segmentation (3S) has received a great deal of attention due to the richness of the semantic information…
Autonomous DrivingDomain AdaptationScene SegmentationSegmentation+1