Learning Texture Invariant Representation for Domain Adaptation of Semantic Segmentation
Since annotating pixel-level labels for semantic segmentation is laborious, leveraging synthetic data is an attractive solution. However, due to the domain gap between synthetic domain and real domain, it is challenging for a model trained with synthetic data to generalize to real data. In this paper, considering the fundamental difference between the two domains as the texture, we propose a method to adapt to the texture of the target domain. First, we diversity the texture of synthetic images using a style transfer algorithm. The various textures of generated images prevent a segmentation model from overfitting to one specific (synthetic) texture. Then, we fine-tune the model with self-training to get direct supervision of the target texture. Our results achieve state-of-the-art performance and we analyze the properties of the model trained on the stylized dataset with extensive experiments.
Code (1)
Tasks
DiversityDomain AdaptationSegmentationSemantic SegmentationStyle TransferSimilar Papers 제목 키워드 기반
All about Structure: Adapting Structural Information across Domains for Boosting Semantic Segmentation
In this paper we tackle the problem of unsupervised domain adaptation for the task of semantic segmentation, where we attempt to transfer the knowledge learned upon synthetic datasets with ground-truth labels to real-wor…
AllDomain AdaptationImage-to-Image TranslationSegmentation+4Learning Disentangled Semantic Representation for Domain Adaptation
Domain adaptation is an important but challenging task. Most of the existing domain adaptation methods struggle to extract the domain-invariant representation on the feature space with entangling domain information and s…
Domain AdaptationDenseTRF: Texture-Aware Unsupervised Representation Adaptation for Surgical Scene Dense Prediction
Dense prediction tasks in surgical computer vision, such as segmentation and surgical zone prediction, can provide valuable guidance for laparoscopic and robotic surgery. However, these models often suffer from distribut…
Geometry-Aware Network for Domain Adaptive Semantic Segmentation
Measuring and alleviating the discrepancies between the synthetic (source) and real scene (target) data is the core issue for domain adaptive semantic segmentation. Though recent works have introduced depth information i…
Depth EstimationDepth PredictionDisentanglementDomain Adaptation+2Unsupervised domain adaptation semantic segmentation of high-resolution remote sensing imagery with invariant domain-level prototype memory
Semantic segmentation is a key technique involved in automatic interpretation of high-resolution remote sensing (HRS) imagery and has drawn much attention in the remote sensing community. Deep convolutional neural networ…
Domain AdaptationPseudo LabelPseudo Label FilteringSegmentation+2