paper-with-me

Papers

NeRF-Casting: Improved View-Dependent Appearance with Consistent Reflections

2024-05-23 · Dor Verbin, Pratul P. Srinivasan, Peter Hedman, Ben Mildenhall, Benjamin Attal, Richard Szeliski, Jonathan T. Barron

Neural Radiance Fields (NeRFs) typically struggle to reconstruct and render highly specular objects, whose appearance varies quickly with changes in viewpoint. Recent works have improved NeRF's ability to render detailed specular appearance of distant environment illumination, but are unable to synthesize consistent reflections of closer content. Moreover, these techniques rely on large computationally-expensive neural networks to model outgoing radiance, which severely limits optimization and rendering speed. We address these issues with an approach based on ray tracing: instead of querying an expensive neural network for the outgoing view-dependent radiance at points along each camera ray, our model casts reflection rays from these points and traces them through the NeRF representation to render feature vectors which are decoded into color using a small inexpensive network. We demonstrate that our model outperforms prior methods for view synthesis of scenes containing shiny objects, and that it is the only existing NeRF method that can synthesize photorealistic specular appearance and reflections in real-world scenes, while requiring comparable optimization time to current state-of-the-art view synthesis models.

📄 PDF Abstract BibTeX arXiv:2405.14871

Code (0)

등록된 구현이 없습니다.

Tasks

NeRF

Similar Papers 제목 키워드 기반

Ref-NeRF: Structured View-Dependent Appearance for Neural Radiance Fields

2021-12-07 · CVPR 2022 1 · Dor Verbin, Peter Hedman, Ben Mildenhall, Todd Zickler 외

Neural Radiance Fields (NeRF) is a popular view synthesis technique that represents a scene as a continuous volumetric function, parameterized by multilayer perceptrons that provide the volume density and view-dependent …

NeRF

Clean-NeRF: Reformulating NeRF to account for View-Dependent Observations

2023-03-26 · Xinhang Liu, Yu-Wing Tai, Chi-Keung Tang

While Neural Radiance Fields (NeRFs) had achieved unprecedented novel view synthesis results, they have been struggling in dealing with large-scale cluttered scenes with sparse input views and highly view-dependent appea…

3D ReconstructionDensity EstimationNeRFNovel View Synthesis+2

Ray Priors through Reprojection: Improving Neural Radiance Fields for Novel View Extrapolation

2022-05-12 · CVPR 2022 1 · Jian Zhang, Yuanqing Zhang, Huan Fu, Xiaowei Zhou 외

Neural Radiance Fields (NeRF) have emerged as a potent paradigm for representing scenes and synthesizing photo-realistic images. A main limitation of conventional NeRFs is that they often fail to produce high-quality ren…

Image GenerationNeRF

UNeRF: Time and Memory Conscious U-Shaped Network for Training Neural Radiance Fields

2022-06-23 · Abiramy Kuganesan, Shih-Yang Su, James J. Little, Helge Rhodin

Neural Radiance Fields (NeRFs) increase reconstruction detail for novel view synthesis and scene reconstruction, with applications ranging from large static scenes to dynamic human motion. However, the increased resoluti…

Density EstimationNeRFNovel View Synthesis

PaletteNeRF: Palette-based Appearance Editing of Neural Radiance Fields

2022-12-21 · CVPR 2023 1 · Zhengfei Kuang, Fujun Luan, Sai Bi, Zhixin Shu 외

Recent advances in neural radiance fields have enabled the high-fidelity 3D reconstruction of complex scenes for novel view synthesis. However, it remains underexplored how the appearance of such representations can be e…

3D ReconstructionNeRFNovel View Synthesis