Bridging the Inter-Domain Gap through Low-Level Features for Cross-Modal Medical Image Segmentation
This paper addresses the task of cross-modal medical image segmentation by exploring unsupervised domain adaptation (UDA) approaches. We propose a model-agnostic UDA framework, LowBridge, which builds on a simple observation that cross-modal images share some similar low-level features (e.g., edges) as they are depicting the same structures. Specifically, we first train a generative model to recover the source images from their edge features, followed by training a segmentation model on the generated source images, separately. At test time, edge features from the target images are input to the pretrained generative model to generate source-style target domain images, which are then segmented using the pretrained segmentation network. Despite its simplicity, extensive experiments on various publicly available datasets demonstrate that \proposed achieves state-of-the-art performance, outperforming eleven existing UDA approaches under different settings. Notably, further ablation studies show that \proposed is agnostic to different types of generative and segmentation models, suggesting its potential to be seamlessly plugged with the most advanced models to achieve even more outstanding results in the future. The code is available at https://github.com/JoshuaLPF/LowBridge.
Code (1)
Tasks
Domain AdaptationImage SegmentationMedical Image SegmentationSegmentationSemantic SegmentationUnsupervised Domain AdaptationSimilar Papers 제목 키워드 기반
BDAN: Mitigating Temporal Difference Across Electrodes in Cross-Subject Motor Imagery Classification via Generative Bridging Domain
Because of "the non-repeatability of the experiment settings and conditions" and "the variability of brain patterns among subjects", the data distributions across sessions and electrodes are different in cross-subject mo…
Domain AdaptationEEGMotor ImageryRethinking Zero-shot Action Recognition: Learning from Latent Atomic Actions
To avoid time-consuming annotating and retraining cycle in applying supervised action recognition models, Zero-Shot Action Recognition (ZSAR) has become a thriving direction. ZSAR requires models to recognize actions th…
Action RecognitionZero-Shot Action RecognitionA Universal Degradation-based Bridging Technique for Domain Adaptive Semantic Segmentation
Semantic segmentation often suffers from significant performance degradation when the trained network is applied to a different domain. To address this issue, unsupervised domain adaptation (UDA) has been extensively stu…
Domain AdaptationSemantic SegmentationUnsupervised Domain AdaptationBridging Gap between Image Pixels and Semantics via Supervision: A Survey
The fact that there exists a gap between low-level features and semantic meanings of images, called the semantic gap, is known for decades. Resolution of the semantic gap is a long standing problem. The semantic gap prob…
Content-Based Image RetrievalImage RetrievalMetric Learningobject-detection+2Video sentence grounding with temporally global textual knowledge
Temporal sentence grounding involves the retrieval of a video moment with a natural language query. Many existing works directly incorporate the given video and temporally localized query for temporal grounding, overlook…
Contrastive LearningRetrievalSentenceTemporal Sentence Grounding