Multi-scale GANs for Memory-efficient Generation of High Resolution Medical Images
Currently generative adversarial networks (GANs) are rarely applied to medical images of large sizes, especially 3D volumes, due to their large computational demand. We propose a novel multi-scale patch-based GAN approach to generate large high resolution 2D and 3D images. Our key idea is to first learn a low-resolution version of the image and then generate patches of successively growing resolutions conditioned on previous scales. In a domain translation use-case scenario, 3D thorax CTs of size 512x512x512 and thorax X-rays of size 2048x2048 are generated and we show that, due to the constant GPU memory demand of our method, arbitrarily large images of high resolution can be generated. Moreover, compared to common patch-based approaches, our multi-resolution scheme enables better image quality and prevents patch artifacts.
Code (2)
Tasks
GPUTranslationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Memory-efficient GAN-based Domain Translation of High Resolution 3D Medical Images
Generative adversarial networks (GANs) are currently rarely applied on 3D medical images of large size, due to their immense computational demand. The present work proposes a multi-scale patch-based GAN approach for esta…
GPUImage GenerationTranslationSETGAN: Scale and Energy Trade-off GANs for Image Applications on Mobile Platforms
We consider the task of photo-realistic unconditional image generation (generate high quality, diverse samples that carry the same visual content as the image) on mobile platforms using Generative Adversarial Networks (G…
Image GenerationSSIMUnconditional Image GenerationParallel/distributed implementation of cellular training for generative adversarial neural networks
Generative adversarial networks (GANs) are widely used to learn generative models. GANs consist of two networks, a generator and a discriminator, that apply adversarial learning to optimize their parameters. This article…
TransGAN: Two Pure Transformers Can Make One Strong GAN, and That Can Scale Up
The recent explosive interest on transformers has suggested their potential to become powerful "universal" models for computer vision tasks, such as classification, detection, and segmentation. While those attempts mainl…
Data AugmentationImage GenerationMemorization Precedes Generation: Learning Unsupervised GANs with Memory Networks
We propose an approach to address two issues that commonly occur during training of unsupervised GANs. First, since GANs use only a continuous latent distribution to embed multiple classes or clusters of data, they often…
Memorization