3D MedDiffusion: A 3D Medical Diffusion Model for Controllable and High-quality Medical Image Generation
The generation of medical images presents significant challenges due to their high-resolution and three-dimensional nature. Existing methods often yield suboptimal performance in generating high-quality 3D medical images, and there is currently no universal generative framework for medical imaging. In this paper, we introduce the 3D Medical Diffusion (3D MedDiffusion) model for controllable, high-quality 3D medical image generation. 3D MedDiffusion incorporates a novel, highly efficient Patch-Volume Autoencoder that compresses medical images into latent space through patch-wise encoding and recovers back into image space through volume-wise decoding. Additionally, we design a new noise estimator to capture both local details and global structure information during diffusion denoising process. 3D MedDiffusion can generate fine-detailed, high-resolution images (up to 512x512x512) and effectively adapt to various downstream tasks as it is trained on large-scale datasets covering CT and MRI modalities and different anatomical regions (from head to leg). Experimental results demonstrate that 3D MedDiffusion surpasses state-of-the-art methods in generative quality and exhibits strong generalizability across tasks such as sparse-view CT reconstruction, fast MRI reconstruction, and data augmentation.
Code (0)
등록된 구현이 없습니다.
Tasks
CT ReconstructionData AugmentationDenoisingImage GenerationMedical Image GenerationMRI ReconstructionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
MedDiffusion: Boosting Health Risk Prediction via Diffusion-based Data Augmentation
Health risk prediction is one of the fundamental tasks under predictive modeling in the medical domain, which aims to forecast the potential health risks that patients may face in the future using their historical Electr…
Data AugmentationPredictionMedDiff-FT: Data-Efficient Diffusion Model Fine-tuning with Structural Guidance for Controllable Medical Image Synthesis
Recent advancements in deep learning for medical image segmentation are often limited by the scarcity of high-quality training data.While diffusion models provide a potential solution by generating synthetic images, thei…
Medical Image SegmentationMedical Image GenerationComputational EfficiencyData AugmentationAnatomically-Controllable Medical Image Generation with Segmentation-Guided Diffusion Models
Diffusion models have enabled remarkably high-quality medical image generation, yet it is challenging to enforce anatomical constraints in generated images. To this end, we propose a diffusion model-based method that sup…
counterfactualImage GenerationMedical Image GenerationDiffBoost: Enhancing Medical Image Segmentation via Text-Guided Diffusion Model
Large-scale, big-variant, high-quality data are crucial for developing robust and successful deep-learning models for medical applications since they potentially enable better generalization performance and avoid overfit…
Data AugmentationImage GenerationImage SegmentationMedical Image Segmentation+2SynBT: High-quality Tumor Synthesis for Breast Tumor Segmentation by 3D Diffusion Model
Synthetic tumors in medical images offer controllable characteristics that facilitate the training of machine learning models, leading to an improved segmentation performance. However, the existing methods of tumor synth…
Tumor Segmentation