DRL-STNet: Unsupervised Domain Adaptation for Cross-modality Medical Image Segmentation via Disentangled Representation Learning
Unsupervised domain adaptation (UDA) is essential for medical image segmentation, especially in cross-modality data scenarios. UDA aims to transfer knowledge from a labeled source domain to an unlabeled target domain, thereby reducing the dependency on extensive manual annotations. This paper presents DRL-STNet, a novel framework for cross-modality medical image segmentation that leverages generative adversarial networks (GANs), disentangled representation learning (DRL), and self-training (ST). Our method leverages DRL within a GAN to translate images from the source to the target modality. Then, the segmentation model is initially trained with these translated images and corresponding source labels and then fine-tuned iteratively using a combination of synthetic and real images with pseudo-labels and real labels. The proposed framework exhibits superior performance in abdominal organ segmentation on the FLARE challenge dataset, surpassing state-of-the-art methods by 11.4% in the Dice similarity coefficient and by 13.1% in the Normalized Surface Dice metric, achieving scores of 74.21% and 80.69%, respectively. The average running time is 41 seconds, and the area under the GPU memory-time curve is 11,292 MB. These results indicate the potential of DRL-STNet for enhancing cross-modality medical image segmentation tasks.
Code (0)
등록된 구현이 없습니다.
Tasks
Domain AdaptationGPUImage SegmentationMedical Image SegmentationOrgan SegmentationRepresentation LearningSegmentationSemantic SegmentationUnsupervised Domain AdaptationSimilar Papers 제목 키워드 기반
Split to Merge: Unifying Separated Modalities for Unsupervised Domain Adaptation
Large vision-language models (VLMs) like CLIP have demonstrated good zero-shot learning performance in the unsupervised domain adaptation task. Yet, most transfer approaches for VLMs focus on either the language or visua…
Domain AdaptationUnsupervised Domain AdaptationZero-Shot LearningLearning Site-specific Styles for Multi-institutional Unsupervised Cross-modality Domain Adaptation
Unsupervised cross-modality domain adaptation is a challenging task in medical image analysis, and it becomes more challenging when source and target domain data are collected from multiple institutions. In this paper, w…
Domain AdaptationMedical Image AnalysisMedical Image SegmentationStyle Transfer+1Cross-View Cross-Modal Unsupervised Domain Adaptation for Driver Monitoring System
Driver distraction remains a leading cause of road traffic accidents, contributing to thousands of fatalities annually across the globe. While deep learning-based driver activity recognition methods have shown promise in…
Unsupervised Domain AdaptationContrastive LearningActivity RecognitionCross-Modality Domain Adaptation for Freespace Detection: A Simple yet Effective Baseline
As one of the fundamental functions of autonomous driving system, freespace detection aims at classifying each pixel of the image captured by the camera as drivable or non-drivable. Current works of freespace detection h…
Autonomous DrivingDomain AdaptationSemantic SegmentationUnsupervised Domain AdaptationUnsupervised Domain Adaptation in Semantic Segmentation Based on Pixel Alignment and Self-Training
This paper proposes an unsupervised cross-modality domain adaptation approach based on pixel alignment and self-training. Pixel alignment transfers ceT1 scans to hrT2 modality, helping to reduce domain shift in the train…
Domain AdaptationSegmentationSemantic SegmentationUnsupervised Domain Adaptation