Unsupervised Domain Adaptation with Semantic Consistency across Heterogeneous Modalities for MRI Prostate Lesion Segmentation
Any novel medical imaging modality that differs from previous protocols e.g. in the number of imaging channels, introduces a new domain that is heterogeneous from previous ones. This common medical imaging scenario is rarely considered in the domain adaptation literature, which handles shifts across domains of the same dimensionality. In our work we rely on stochastic generative modeling to translate across two heterogeneous domains at pixel space and introduce two new loss functions that promote semantic consistency. Firstly, we introduce a semantic cycle-consistency loss in the source domain to ensure that the translation preserves the semantics. Secondly, we introduce a pseudo-labelling loss, where we translate target data to source, label them by a source-domain network, and use the generated pseudo-labels to supervise the target-domain network. Our results show that this allows us to extract systematically better representations for the target domain. In particular, we address the challenge of enhancing performance on VERDICT-MRI, an advanced diffusion-weighted imaging technique, by exploiting labeled mp-MRI data. When compared to several unsupervised domain adaptation approaches, our approach yields substantial improvements, that consistently carry over to the semi-supervised and supervised learning settings.
Code (0)
등록된 구현이 없습니다.
Tasks
Domain AdaptationLesion SegmentationTranslationUnsupervised Domain AdaptationSimilar Papers 제목 키워드 기반
Preserving Semantic Consistency in Unsupervised Domain Adaptation Using Generative Adversarial Networks
Unsupervised domain adaptation seeks to mitigate the distribution discrepancy between source and target domains, given labeled samples of the source domain and unlabeled samples of the target domain. Generative adversari…
Domain AdaptationGenerative Adversarial NetworkUnsupervised Domain AdaptationPixMatch: Unsupervised Domain Adaptation via Pixelwise Consistency Training
Unsupervised domain adaptation is a promising technique for semantic segmentation and other computer vision tasks for which large-scale data annotation is costly and time-consuming. In semantic segmentation, it is attrac…
Domain AdaptationSemantic SegmentationSynthetic-to-Real TranslationUnsupervised Domain AdaptationUnsupervised Domain Adaptation for Semantic Segmentation using One-shot Image-to-Image Translation via Latent Representation Mixing
Domain adaptation is one of the prominent strategies for handling both domain shift, that is widely encountered in large-scale land use/land cover map calculation, and the scarcity of pixel-level ground truth that is cru…
DecoderDomain AdaptationImage-to-Image TranslationSemantic Segmentation+1Multi-Target Domain Adaptation with Collaborative Consistency Learning
Recently unsupervised domain adaptation for the semantic segmentation task has become more and more popular due to high-cost of pixel-level annotation on real-world images. However, most domain adaptation methods are onl…
Domain AdaptationMulti-target Domain AdaptationSemantic SegmentationUnsupervised Domain AdaptationSemantically Consistent Image-to-Image Translation for Unsupervised Domain Adaptation
Unsupervised Domain Adaptation (UDA) aims to adapt models trained on a source domain to a new target domain where no labelled data is available. In this work, we investigate the problem of UDA from a synthetic computer-g…
Domain AdaptationImage-to-Image TranslationSemantic SegmentationTranslation+1