Mask CycleGAN: Unpaired Multi-modal Domain Translation with Interpretable Latent Variable
We propose Mask CycleGAN, a novel architecture for unpaired image domain translation built based on CycleGAN, with an aim to address two issues: 1) unimodality in image translation and 2) lack of interpretability of latent variables. Our innovation in the technical approach is comprised of three key components: masking scheme, generator and objective. Experimental results demonstrate that this architecture is capable of bringing variations to generated images in a controllable manner and is reasonably robust to different masks.
Code (1)
Tasks
TranslationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
A Vessel-Segmentation-Based CycleGAN for Unpaired Multi-modal Retinal Image Synthesis
Unpaired image-to-image translation of retinal images can efficiently increase the training dataset for deep-learning-based multi-modal retinal registration methods. Our method integrates a vessel segmentation network in…
Image GenerationImage RegistrationImage-to-Image TranslationSegmentation+1DC-cycleGAN: Bidirectional CT-to-MR Synthesis from Unpaired Data
Magnetic resonance (MR) and computer tomography (CT) images are two typical types of medical images that provide mutually-complementary information for accurate clinical diagnosis and treatment. However, obtaining both i…
Image GenerationSSIMAugmented CycleGAN: Learning Many-to-Many Mappings from Unpaired Data
Learning inter-domain mappings from unpaired data can improve performance in structured prediction tasks, such as image segmentation, by reducing the need for paired data. CycleGAN was recently proposed for this problem,…
Image SegmentationSemantic SegmentationStructured PredictionBridging the gap between paired and unpaired medical image translation
Medical image translation has the potential to reduce the imaging workload, by removing the need to capture some sequences, and to reduce the annotation burden for developing machine learning methods. GANs have been used…
TranslationCross-modality Knowledge Transfer for Prostate Segmentation from CT Scans
Creating large scale high-quality annotations is a known challenge in medical imaging. In this work, based on the CycleGAN algorithm, we propose leveraging annotations from one modality to be useful in other modalities. …
Image SegmentationMedical Image SegmentationSegmentationSemantic Segmentation+2