paper-with-me

홈 › Papers

DP-NeRF: Deblurred Neural Radiance Field with Physical Scene Priors

2022-11-22 · CVPR 2023 1 · Dogyoon Lee, Minhyeok Lee, Chajin Shin, Sangyoun Lee

Neural Radiance Field (NeRF) has exhibited outstanding three-dimensional (3D) reconstruction quality via the novel view synthesis from multi-view images and paired calibrated camera parameters. However, previous NeRF-based systems have been demonstrated under strictly controlled settings, with little attention paid to less ideal scenarios, including with the presence of noise such as exposure, illumination changes, and blur. In particular, though blur frequently occurs in real situations, NeRF that can handle blurred images has received little attention. The few studies that have investigated NeRF for blurred images have not considered geometric and appearance consistency in 3D space, which is one of the most important factors in 3D reconstruction. This leads to inconsistency and the degradation of the perceptual quality of the constructed scene. Hence, this paper proposes a DP-NeRF, a novel clean NeRF framework for blurred images, which is constrained with two physical priors. These priors are derived from the actual blurring process during image acquisition by the camera. DP-NeRF proposes rigid blurring kernel to impose 3D consistency utilizing the physical priors and adaptive weight proposal to refine the color composition error in consideration of the relationship between depth and blur. We present extensive experimental results for synthetic and real scenes with two types of blur: camera motion blur and defocus blur. The results demonstrate that DP-NeRF successfully improves the perceptual quality of the constructed NeRF ensuring 3D geometric and appearance consistency. We further demonstrate the effectiveness of our model with comprehensive ablation analysis.

📄 PDF Abstract BibTeX arXiv:2211.12046

Code (1)

dogyoonlee/dp-nerf 공식 구현 pytorch

Tasks

3D ReconstructionNeRFNovel View Synthesis

Similar Papers 제목 키워드 기반

Sparse-DeRF: Deblurred Neural Radiance Fields from Sparse View

2024-07-09 · Dogyoon Lee, Donghyeong Kim, Jungho Lee, Minhyeok Lee 외

Recent studies construct deblurred neural radiance fields~(DeRF) using dozens of blurry images, which are not practical scenarios if only a limited number of blurry images are available. This paper focuses on constructin…

DeblurringImage DeblurringNeRF

ClimateNeRF: Extreme Weather Synthesis in Neural Radiance Field

2022-11-23 · ICCV 2023 1 · Yuan Li, Zhi-Hao Lin, David Forsyth, Jia-Bin Huang 외

Physical simulations produce excellent predictions of weather effects. Neural radiance fields produce SOTA scene models. We describe a novel NeRF-editing procedure that can fuse physical simulations with NeRF models of s…

NeRFNeural RenderingPhysical Simulations

Dynamic Appearance Particle Neural Radiance Field

2023-10-11 · Ancheng Lin, Jun Li

Neural Radiance Fields (NeRFs) have shown great potential in modelling 3D scenes. Dynamic NeRFs extend this model by capturing time-varying elements, typically using deformation fields. The existing dynamic NeRFs employ …

NeRF

Surf-NeRF: Surface Regularised Neural Radiance Fields

2024-11-27 · Jack Naylor, Viorela Ila, Donald G. Dansereau

Neural Radiance Fields (NeRFs) provide a high fidelity, continuous scene representation that can realistically represent complex behaviour of light. Despite recent works like Ref-NeRF improving geometry through physics-i…

NeRF

NeRFMeshing: Distilling Neural Radiance Fields into Geometrically-Accurate 3D Meshes

2023-03-16 · Marie-Julie Rakotosaona, Fabian Manhardt, Diego Martin Arroyo, Michael Niemeyer 외

With the introduction of Neural Radiance Fields (NeRFs), novel view synthesis has recently made a big leap forward. At the core, NeRF proposes that each 3D point can emit radiance, allowing to conduct view synthesis usin…

NeRFNovel View SynthesisSurface Reconstruction