paper-with-me

홈 › Papers

ReconFusion: 3D Reconstruction with Diffusion Priors

2023-12-05 · CVPR 2024 1 · Rundi Wu, Ben Mildenhall, Philipp Henzler, Keunhong Park, Ruiqi Gao, Daniel Watson, Pratul P. Srinivasan, Dor Verbin, Jonathan T. Barron, Ben Poole, Aleksander Holynski

3D reconstruction methods such as Neural Radiance Fields (NeRFs) excel at rendering photorealistic novel views of complex scenes. However, recovering a high-quality NeRF typically requires tens to hundreds of input images, resulting in a time-consuming capture process. We present ReconFusion to reconstruct real-world scenes using only a few photos. Our approach leverages a diffusion prior for novel view synthesis, trained on synthetic and multiview datasets, which regularizes a NeRF-based 3D reconstruction pipeline at novel camera poses beyond those captured by the set of input images. Our method synthesizes realistic geometry and texture in underconstrained regions while preserving the appearance of observed regions. We perform an extensive evaluation across various real-world datasets, including forward-facing and 360-degree scenes, demonstrating significant performance improvements over previous few-view NeRF reconstruction approaches.

📄 PDF Abstract BibTeX arXiv:2312.02981

Code (0)

등록된 구현이 없습니다.

Tasks

3D ReconstructionNeRFNovel View Synthesis

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically
Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

When are Diffusion Priors Helpful in Sparse Reconstruction? A Study with Sparse-view CT

2025-02-04 · Matt Y. Cheung, Sophia Zorek, Tucker J. Netherton, Laurence E. Court 외

Diffusion models demonstrate state-of-the-art performance on image generation, and are gaining traction for sparse medical image reconstruction tasks. However, compared to classical reconstruction algorithms relying on s…

Computed Tomography (CT)Image GenerationImage Reconstruction

Consistency Diffusion Models for Single-Image 3D Reconstruction with Priors

2025-01-28 · Chenru Jiang, Chengrui Zhang, Xi Yang, Jie Sun 외

This paper delves into the study of 3D point cloud reconstruction from a single image. Our objective is to develop the Consistency Diffusion Model, exploring synergistic 2D and 3D priors in the Bayesian framework to ensu…

3D Point Cloud Reconstruction3D ReconstructionPoint cloud reconstruction

Learning Fourier-Constrained Diffusion Bridges for MRI Reconstruction

2023-08-02 · Muhammad U. Mirza, Onat Dalmaz, Hasan A. Bedel, Gokberk Elmas 외

Deep generative models have gained recent traction in accelerated MRI reconstruction. Diffusion priors are particularly promising given their representational fidelity. Instead of the target transformation from undersamp…

MRI Reconstruction

Scale-Cascaded Diffusion Models for Super-Resolution in Medical Imaging

2026-01-30 · Darshan Thaker, Mahmoud Mostapha, Radu Miron, Shihan Qiu 외 arxiv

Diffusion models have been increasingly used as strong generative priors for solving inverse problems such as super-resolution in medical imaging. However, these approaches typically utilize a diffusion prior trained at …

Image Super-Resolution

Patch-Based Diffusion for Data-Efficient, Radiologist-Preferred MRI Reconstruction

2025-09-25 · Rohan Sanda, Asad Aali, Andrew Johnston, Eduardo Reis 외 arxiv

Magnetic resonance imaging (MRI) requires long acquisition times, raising costs, reducing accessibility, and making scans more susceptible to motion artifacts. Diffusion probabilistic models that learn data-driven priors…

MRI Reconstruction