ReconFusion: 3D Reconstruction with Diffusion Priors
3D reconstruction methods such as Neural Radiance Fields (NeRFs) excel at rendering photorealistic novel views of complex scenes. However, recovering a high-quality NeRF typically requires tens to hundreds of input images, resulting in a time-consuming capture process. We present ReconFusion to reconstruct real-world scenes using only a few photos. Our approach leverages a diffusion prior for novel view synthesis, trained on synthetic and multiview datasets, which regularizes a NeRF-based 3D reconstruction pipeline at novel camera poses beyond those captured by the set of input images. Our method synthesizes realistic geometry and texture in underconstrained regions while preserving the appearance of observed regions. We perform an extensive evaluation across various real-world datasets, including forward-facing and 360-degree scenes, demonstrating significant performance improvements over previous few-view NeRF reconstruction approaches.
Code (0)
등록된 구현이 없습니다.
Tasks
3D ReconstructionNeRFNovel View SynthesisMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
When are Diffusion Priors Helpful in Sparse Reconstruction? A Study with Sparse-view CT
Diffusion models demonstrate state-of-the-art performance on image generation, and are gaining traction for sparse medical image reconstruction tasks. However, compared to classical reconstruction algorithms relying on s…
Computed Tomography (CT)Image GenerationImage ReconstructionConsistency Diffusion Models for Single-Image 3D Reconstruction with Priors
This paper delves into the study of 3D point cloud reconstruction from a single image. Our objective is to develop the Consistency Diffusion Model, exploring synergistic 2D and 3D priors in the Bayesian framework to ensu…
3D Point Cloud Reconstruction3D ReconstructionPoint cloud reconstructionLearning Fourier-Constrained Diffusion Bridges for MRI Reconstruction
Deep generative models have gained recent traction in accelerated MRI reconstruction. Diffusion priors are particularly promising given their representational fidelity. Instead of the target transformation from undersamp…
MRI ReconstructionScale-Cascaded Diffusion Models for Super-Resolution in Medical Imaging
Diffusion models have been increasingly used as strong generative priors for solving inverse problems such as super-resolution in medical imaging. However, these approaches typically utilize a diffusion prior trained at …
Image Super-ResolutionPatch-Based Diffusion for Data-Efficient, Radiologist-Preferred MRI Reconstruction
Magnetic resonance imaging (MRI) requires long acquisition times, raising costs, reducing accessibility, and making scans more susceptible to motion artifacts. Diffusion probabilistic models that learn data-driven priors…
MRI Reconstruction