Unsupervised Cross-Modality Domain Adaptation of ConvNets for Biomedical Image Segmentations with Adversarial Loss
Convolutional networks (ConvNets) have achieved great successes in various challenging vision tasks. However, the performance of ConvNets would degrade when encountering the domain shift. The domain adaptation is more significant while challenging in the field of biomedical image analysis, where cross-modality data have largely different distributions. Given that annotating the medical data is especially expensive, the supervised transfer learning approaches are not quite optimal. In this paper, we propose an unsupervised domain adaptation framework with adversarial learning for cross-modality biomedical image segmentations. Specifically, our model is based on a dilated fully convolutional network for pixel-wise prediction. Moreover, we build a plug-and-play domain adaptation module (DAM) to map the target input to features which are aligned with source domain feature space. A domain critic module (DCM) is set up for discriminating the feature space of both domains. We optimize the DAM and DCM via an adversarial loss without using any target domain label. Our proposed method is validated by adapting a ConvNet trained with MRI images to unpaired CT data for cardiac structures segmentations, and achieved very promising results.
Code (2)
Tasks
Domain AdaptationTransfer LearningUnsupervised Domain AdaptationSimilar Papers 제목 키워드 기반
Split to Merge: Unifying Separated Modalities for Unsupervised Domain Adaptation
Large vision-language models (VLMs) like CLIP have demonstrated good zero-shot learning performance in the unsupervised domain adaptation task. Yet, most transfer approaches for VLMs focus on either the language or visua…
Domain AdaptationUnsupervised Domain AdaptationZero-Shot LearningLearning Site-specific Styles for Multi-institutional Unsupervised Cross-modality Domain Adaptation
Unsupervised cross-modality domain adaptation is a challenging task in medical image analysis, and it becomes more challenging when source and target domain data are collected from multiple institutions. In this paper, w…
Domain AdaptationMedical Image AnalysisMedical Image SegmentationStyle Transfer+1Cross-View Cross-Modal Unsupervised Domain Adaptation for Driver Monitoring System
Driver distraction remains a leading cause of road traffic accidents, contributing to thousands of fatalities annually across the globe. While deep learning-based driver activity recognition methods have shown promise in…
Unsupervised Domain AdaptationContrastive LearningActivity RecognitionCross-Modality Domain Adaptation for Freespace Detection: A Simple yet Effective Baseline
As one of the fundamental functions of autonomous driving system, freespace detection aims at classifying each pixel of the image captured by the camera as drivable or non-drivable. Current works of freespace detection h…
Autonomous DrivingDomain AdaptationSemantic SegmentationUnsupervised Domain AdaptationUnsupervised Domain Adaptation in Semantic Segmentation Based on Pixel Alignment and Self-Training
This paper proposes an unsupervised cross-modality domain adaptation approach based on pixel alignment and self-training. Pixel alignment transfers ceT1 scans to hrT2 modality, helping to reduce domain shift in the train…
Domain AdaptationSegmentationSemantic SegmentationUnsupervised Domain Adaptation