Domain Adaptation for Structured Output via Disentangled Patch Representations
Predicting structured outputs such as semantic segmentation relies on expensive per-pixel annotations to learn strong supervised models like convolutional neural networks. However, these models trained on one data domain may not generalize well to other domains unequipped with annotations for model finetuning. To avoid the labor-intensive process of annotation, we develop a domain adaptation method to adapt the source data to the unlabeled target domain. To this end, we propose to learn discriminative feature representations of patches based on label histograms in the source domain, through the construction of a disentangled space. With such representations as guidance, we then use an adversarial learning scheme to push the feature representations in target patches to the closer distributions in source ones. In addition, we show that our framework can integrate a global alignment process with the proposed patch-level alignment and achieve state-of-the-art performance on semantic segmentation. Extensive ablation studies and experiments are conducted on numerous benchmark datasets with various settings, such as synthetic-to-real and cross-city scenarios.
Code (0)
등록된 구현이 없습니다.
Tasks
Domain AdaptationSemantic SegmentationSimilar Papers 제목 키워드 기반
Domain Adaptation for Structured Output via Discriminative Patch Representations
Predicting structured outputs such as semantic segmentation relies on expensive per-pixel annotations to learn supervised models like convolutional neural networks. However, models trained on one data domain may not gene…
Domain AdaptationImage-to-Image TranslationSegmentationSemantic Segmentation+1Graph Domain Adaptation: A Generative View
Recent years have witnessed tremendous interest in deep learning on graph-structured data. Due to the high cost of collecting labeled graph-structured data, domain adaptation is important to supervised graph learning tas…
DisentanglementDomain AdaptationGraph ClassificationGRAPH DOMAIN ADAPTATION+2Diverse Image-to-Image Translation via Disentangled Representations
Image-to-image translation aims to learn the mapping between two visual domains. There are two main challenges for many applications: 1) the lack of aligned training pairs and 2) multiple possible outputs from a single i…
AttributeDiversityDomain AdaptationImage-to-Image Translation+4DOME: Learning Transferable Domain Variables from Sparse Supervision for Test-Time Adaptation
Test-time adaptation (TTA) aims to align a model to shifting test domains using only unlabeled streaming data. Most existing methods implicitly infer a single global domain distribution, ignoring the multidimensional and…
Test-time AdaptationDomain Adaptation Meets Disentangled Representation Learning and Style Transfer
Many methods have been proposed to solve the domain adaptation problem recently. However, the success of them implicitly funds on the assumption that the information of domains are fully transferrable. If the assumption …
Domain AdaptationRepresentation LearningStyle TransferTransfer Learning