Multi-resolution Guided 3D GANs for Medical Image Translation
Medical image translation is the process of converting from one imaging modality to another, in order to reduce the need for multiple image acquisitions from the same patient. This can enhance the efficiency of treatment by reducing the time, equipment, and labor needed. In this paper, we introduce a multi-resolution guided Generative Adversarial Network (GAN)-based framework for 3D medical image translation. Our framework uses a 3D multi-resolution Dense-Attention UNet (3D-mDAUNet) as the generator and a 3D multi-resolution UNet as the discriminator, optimized with a unique combination of loss functions including voxel-wise GAN loss and 2.5D perception loss. Our approach yields promising results in volumetric image quality assessment (IQA) across a variety of imaging modalities, body regions, and age groups, demonstrating its robustness. Furthermore, we propose a synthetic-to-real applicability assessment as an additional evaluation to assess the effectiveness of synthetic data in downstream applications such as segmentation. This comprehensive evaluation shows that our method produces synthetic medical images not only of high-quality but also potentially useful in clinical applications. Our code is available at github.com/juhha/3D-mADUNet.
Code (1)
Tasks
Generative Adversarial NetworkImage Quality AssessmentTranslationSimilar Papers 제목 키워드 기반
Memory-Efficient 3D High-Resolution Medical Image Synthesis Using CRF-Guided GANs
Generative Adversarial Networks (GANs) have many potential medical imaging applications. Due to the limited memory of Graphical Processing Units (GPUs), most current 3D GAN models are trained on low-resolution medical im…
Image GenerationMulti-scale GANs for Memory-efficient Generation of High Resolution Medical Images
Currently generative adversarial networks (GANs) are rarely applied to medical images of large sizes, especially 3D volumes, due to their large computational demand. We propose a novel multi-scale patch-based GAN approac…
GPUTranslationHigh-resolution medical image synthesis using progressively grown generative adversarial networks
Generative adversarial networks (GANs) are a class of unsupervised machine learning algorithms that can produce realistic images from randomly-sampled vectors in a multi-dimensional space. Until recently, it was not poss…
Image AugmentationImage GenerationVocal Bursts Intensity PredictionMelanoGANs: High Resolution Skin Lesion Synthesis with GANs
Generative Adversarial Networks (GANs) have been successfully used to synthesize realistically looking images of faces, scenery and even medical images. Unfortunately, they usually require large training datasets, which …
Image GenerationLesion ClassificationSkin Lesion ClassificationVocal Bursts Intensity PredictionMemory-efficient GAN-based Domain Translation of High Resolution 3D Medical Images
Generative adversarial networks (GANs) are currently rarely applied on 3D medical images of large size, due to their immense computational demand. The present work proposes a multi-scale patch-based GAN approach for esta…
GPUImage GenerationTranslation