Progressively Volumetrized Deep Generative Models for Data-Efficient Contextual Learning of MR Image Recovery
Magnetic resonance imaging (MRI) offers the flexibility to image a given anatomic volume under a multitude of tissue contrasts. Yet, scan time considerations put stringent limits on the quality and diversity of MRI data. The gold-standard approach to alleviate this limitation is to recover high-quality images from data undersampled across various dimensions, most commonly the Fourier domain or contrast sets. A primary distinction among recovery methods is whether the anatomy is processed per volume or per cross-section. Volumetric models offer enhanced capture of global contextual information, but they can suffer from suboptimal learning due to elevated model complexity. Cross-sectional models with lower complexity offer improved learning behavior, yet they ignore contextual information across the longitudinal dimension of the volume. Here, we introduce a novel progressive volumetrization strategy for generative models (ProvoGAN) that serially decomposes complex volumetric image recovery tasks into successive cross-sectional mappings task-optimally ordered across individual rectilinear dimensions. ProvoGAN effectively captures global context and recovers fine-structural details across all dimensions, while maintaining low model complexity and improved learning behaviour. Comprehensive demonstrations on mainstream MRI reconstruction and synthesis tasks show that ProvoGAN yields superior performance to state-of-the-art volumetric and cross-sectional models.
Code (0)
등록된 구현이 없습니다.
Tasks
AnatomyMRI ReconstructionSimilar Papers 제목 키워드 기반
Pioneer Networks: Progressively Growing Generative Autoencoder
We introduce a novel generative autoencoder network model that learns to encode and reconstruct images with high quality and resolution, and supports smooth random sampling from the latent space of the encoder. Generativ…
Image GenerationMedGEN-Bench: Contextually entangled benchmark for open-ended multimodal medical generation
As Vision-Language Models (VLMs) increasingly gain traction in medical applications, clinicians are progressively expecting AI systems not only to generate textual diagnoses but also to produce corresponding medical imag…
Visual Question Answeringmultimodal generationImage GenerationImage EditingProgressively Unfreezing Perceptual GAN
Generative adversarial networks (GANs) are widely used in image generation tasks, yet the generated images are usually lack of texture details. In this paper, we propose a general framework, called Progressively Unfreezi…
Image GenerationImage Super-ResolutionImage-to-Image TranslationSuper-Resolution+1Learning to Inpaint by Progressively Growing the Mask Regions
Image inpainting is one of the most challenging tasks in computer vision. Recently, generative-based image inpainting methods have been shown to produce visually plausible images. However, they still have difficulties to…
Image InpaintingProgressive Prompt Detailing for Improved Alignment in Text-to-Image Generative Models
Text-to-image generative models often struggle with long prompts detailing complex scenes, diverse objects with distinct visual characteristics and spatial relationships. In this work, we propose SCoPE (Scheduled interpo…
Question AnsweringVisual Question AnsweringVisual Question Answering (VQA)