paper-with-me

홈 › Papers

Rethinking Directional Integration in Neural Radiance Fields

2023-11-28 · Congyue Deng, Jiawei Yang, Leonidas Guibas, Yue Wang

Recent works use the Neural radiance field (NeRF) to perform multi-view 3D reconstruction, providing a significant leap in rendering photorealistic scenes. However, despite its efficacy, NeRF exhibits limited capability of learning view-dependent effects compared to light field rendering or image-based view synthesis. To that end, we introduce a modification to the NeRF rendering equation which is as simple as a few lines of code change for any NeRF variations, while greatly improving the rendering quality of view-dependent effects. By swapping the integration operator and the direction decoder network, we only integrate the positional features along the ray and move the directional terms out of the integration, resulting in a disentanglement of the view-dependent and independent components. The modified equation is equivalent to the classical volumetric rendering in ideal cases on object surfaces with Dirac densities. Furthermore, we prove that with the errors caused by network approximation and numerical integration, our rendering equation exhibits better convergence properties with lower error accumulations compared to the classical NeRF. We also show that the modified equation can be interpreted as light field rendering with learned ray embeddings. Experiments on different NeRF variations show consistent improvements in the quality of view-dependent effects with our simple modification.

📄 PDF Abstract BibTeX arXiv:2311.16504

Code (0)

등록된 구현이 없습니다.

Tasks

3D ReconstructionDecoderDisentanglementMulti-View 3D ReconstructionNeRFNumerical Integration

Similar Papers 제목 키워드 기반

Rethinking Directional Parameterization in Neural Implicit Surface Reconstruction

2024-09-11 · Zijie Jiang, Tianhan Xu, Hiroharu Kato

Multi-view 3D surface reconstruction using neural implicit representations has made notable progress by modeling the geometry and view-dependent radiance fields within a unified framework. However, their effectiveness in…

Surface Reconstruction

OmniLocalRF: Omnidirectional Local Radiance Fields from Dynamic Videos

2024-03-31 · CVPR 2024 1 · Dongyoung Choi, Hyeonjoong Jang, Min H. Kim

Omnidirectional cameras are extensively used in various applications to provide a wide field of vision. However, they face a challenge in synthesizing novel views due to the inevitable presence of dynamic objects, includ…

Pose Estimation

SpecNeRF: Gaussian Directional Encoding for Specular Reflections

2023-12-20 · CVPR 2024 1 · Li Ma, Vasu Agrawal, Haithem Turki, Changil Kim 외

Neural radiance fields have achieved remarkable performance in modeling the appearance of 3D scenes. However, existing approaches still struggle with the view-dependent appearance of glossy surfaces, especially under com…

OmniNeRF: Hybriding Omnidirectional Distance and Radiance fields for Neural Surface Reconstruction

2022-09-27 · Jiaming Shen, Bolin Song, Zirui Wu, Yi Xu

3D reconstruction from images has wide applications in Virtual Reality and Automatic Driving, where the precision requirement is very high. Ground-breaking research in the neural radiance field (NeRF) by utilizing Multi-…

3D Reconstruction3D Scene Reconstruction3D Shape RepresentationNeRF+1

360Roam: Real-Time Indoor Roaming Using Geometry-Aware 360$^\circ$ Radiance Fields

2022-08-04 · Huajian Huang, Yingshu Chen, Tianjia Zhang, Sai-Kit Yeung

Virtual tour among sparse 360$^\circ$ images is widely used while hindering smooth and immersive roaming experiences. The emergence of Neural Radiance Field (NeRF) has showcased significant progress in synthesizing novel…

NeRFNovel View Synthesis