CSCL: Critical Semantic-Consistent Learning for Unsupervised Domain Adaptation
Unsupervised domain adaptation without consuming annotation process for unlabeled target data attracts appealing interests in semantic segmentation. However, 1) existing methods neglect that not all semantic representations across domains are transferable, which cripples domain-wise transfer with untransferable knowledge; 2) they fail to narrow category-wise distribution shift due to category-agnostic feature alignment. To address above challenges, we develop a new Critical Semantic-Consistent Learning (CSCL) model, which mitigates the discrepancy of both domain-wise and category-wise distributions. Specifically, a critical transfer based adversarial framework is designed to highlight transferable domain-wise knowledge while neglecting untransferable knowledge. Transferability-critic guides transferability-quantizer to maximize positive transfer gain under reinforcement learning manner, although negative transfer of untransferable knowledge occurs. Meanwhile, with the help of confidence-guided pseudo labels generator of target samples, a symmetric soft divergence loss is presented to explore inter-class relationships and facilitate category-wise distribution alignment. Experiments on several datasets demonstrate the superiority of our model.
Code (0)
등록된 구현이 없습니다.
Tasks
Domain AdaptationSemantic SegmentationUnsupervised Domain AdaptationSimilar Papers 제목 키워드 기반
Context-self contrastive pretraining for crop type semantic segmentation
In this paper, we propose a fully supervised pre-training scheme based on contrastive learning particularly tailored to dense classification tasks. The proposed Context-Self Contrastive Loss (CSCL) learns an embedding sp…
Contrastive LearningSegmentationSemantic SegmentationSuper-Resolution+2OmicsCL: Unsupervised Contrastive Learning for Cancer Subtype Discovery and Survival Stratification
Unsupervised learning of disease subtypes from multi-omics data presents a significant opportunity for advancing personalized medicine. We introduce OmicsCL, a modular contrastive learning framework that jointly embeds h…
Contrastive LearningBrain Image Synthesis With Unsupervised Multivariate Canonical CSCl4Net
Recent advances in neuroscience have highlighted the effectiveness of multi-modal medical data for investigating certain pathologies and understanding human cognition. However, obtaining full sets of different modali…
Image GenerationHierarchical Cross-Modality Semantic Correlation Learning Model for Multimodal Summarization
Multimodal summarization with multimodal output (MSMO) generates a summary with both textual and visual content. Multimodal news report contains heterogeneous contents, which makes MSMO nontrivial. Moreover, it is observ…
DiversityUnleashing the Potential of Consistency Learning for Detecting and Grounding Multi-Modal Media Manipulation
To tackle the threat of fake news, the task of detecting and grounding multi-modal media manipulation DGM4 has received increasing attention. However, most state-of-the-art methods fail to explore the fine-grained consis…
Decoder