paper-with-me

홈 › Papers

DiffusionBlend: Learning 3D Image Prior through Position-aware Diffusion Score Blending for 3D Computed Tomography Reconstruction

2024-06-14 · Bowen Song, Jason Hu, ZhaoXu Luo, Jeffrey A. Fessler, Liyue Shen

Diffusion models face significant challenges when employed for large-scale medical image reconstruction in real practice such as 3D Computed Tomography (CT). Due to the demanding memory, time, and data requirements, it is difficult to train a diffusion model directly on the entire volume of high-dimensional data to obtain an efficient 3D diffusion prior. Existing works utilizing diffusion priors on single 2D image slice with hand-crafted cross-slice regularization would sacrifice the z-axis consistency, which results in severe artifacts along the z-axis. In this work, we propose a novel framework that enables learning the 3D image prior through position-aware 3D-patch diffusion score blending for reconstructing large-scale 3D medical images. To the best of our knowledge, we are the first to utilize a 3D-patch diffusion prior for 3D medical image reconstruction. Extensive experiments on sparse view and limited angle CT reconstruction show that our DiffusionBlend method significantly outperforms previous methods and achieves state-of-the-art performance on real-world CT reconstruction problems with high-dimensional 3D image (i.e., $256 \times 256 \times 500$). Our algorithm also comes with better or comparable computational efficiency than previous state-of-the-art methods.

📄 PDF Abstract BibTeX arXiv:2406.10211

Code (0)

등록된 구현이 없습니다.

Tasks

Computational EfficiencyComputed Tomography (CT)CT ReconstructionImage ReconstructionPosition

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

Human Motion Diffusion as a Generative Prior

2023-03-02 · Yonatan Shafir, Guy Tevet, Roy Kapon, Amit H. Bermano

Recent work has demonstrated the significant potential of denoising diffusion models for generating human motion, including text-to-motion capabilities. However, these methods are restricted by the paucity of annotated m…

DenoisingMotion Synthesis

Learning Image Priors through Patch-based Diffusion Models for Solving Inverse Problems

2024-06-04 · Jason Hu, Bowen Song, Xiaojian Xu, Liyue Shen 외

Diffusion models can learn strong image priors from underlying data distribution and use them to solve inverse problems, but the training process is computationally expensive and requires lots of data. Such bottlenecks p…

CT ReconstructionDeblurring

ComposeAnything: Composite Object Priors for Text-to-Image Generation

2025-05-30 · Zeeshan Khan, ShiZhe Chen, Cordelia Schmid

Generating images from text involving complex and novel object arrangements remains a significant challenge for current text-to-image (T2I) models. Although prior layout-based methods improve object arrangements using sp…

DenoisingImage GenerationObjectText to Image Generation+1

G-NeRF: Geometry-enhanced Novel View Synthesis from Single-View Images

2024-04-11 · CVPR 2024 1 · Zixiong Huang, Qi Chen, Libo Sun, Yifan Yang 외

Novel view synthesis aims to generate new view images of a given view image collection. Recent attempts address this problem relying on 3D geometry priors (e.g., shapes, sizes, and positions) learned from multi-view imag…

3D geometryNeRFNovel View Synthesis

Texture-aware Intrinsic Image Decomposition with Model- and Learning-based Priors

2025-09-11 · Xiaodong Wang, Zijun He, Xin Yuan arxiv

This paper aims to recover the intrinsic reflectance layer and shading layer given a single image. Though this intrinsic image decomposition problem has been studied for decades, it remains a significant challenge in cas…