paper-with-me

Papers

PBR-NeRF: Inverse Rendering with Physics-Based Neural Fields

2024-12-12 · CVPR 2025 1 · Sean Wu, Shamik Basu, Tim Broedermann, Luc van Gool, Christos Sakaridis

We tackle the ill-posed inverse rendering problem in 3D reconstruction with a Neural Radiance Field (NeRF) approach informed by Physics-Based Rendering (PBR) theory, named PBR-NeRF. Our method addresses a key limitation in most NeRF and 3D Gaussian Splatting approaches: they estimate view-dependent appearance without modeling scene materials and illumination. To address this limitation, we present an inverse rendering (IR) model capable of jointly estimating scene geometry, materials, and illumination. Our model builds upon recent NeRF-based IR approaches, but crucially introduces two novel physics-based priors that better constrain the IR estimation. Our priors are rigorously formulated as intuitive loss terms and achieve state-of-the-art material estimation without compromising novel view synthesis quality. Our method is easily adaptable to other inverse rendering and 3D reconstruction frameworks that require material estimation. We demonstrate the importance of extending current neural rendering approaches to fully model scene properties beyond geometry and view-dependent appearance. Code is publicly available at https://github.com/s3anwu/pbrnerf

📄 PDF Abstract BibTeX arXiv:2412.09680

Code (1)

s3anwu/pbrnerf 공식 구현 pytorch

Tasks

3D ReconstructionInverse RenderingNeRFNeural RenderingNovel View Synthesis

Similar Papers 제목 키워드 기반

NeRF as a Non-Distant Environment Emitter in Physics-based Inverse Rendering

2024-02-07 · Jingwang Ling, Ruihan Yu, Feng Xu, Chun Du 외

Physics-based inverse rendering enables joint optimization of shape, material, and lighting based on captured 2D images. To ensure accurate reconstruction, using a light model that closely resembles the captured environm…

Inverse RenderingNeRF

Inverse Rendering of Glossy Objects via the Neural Plenoptic Function and Radiance Fields

2024-03-24 · CVPR 2024 1 · Haoyuan Wang, WenBo Hu, Lei Zhu, Rynson W. H. Lau

Inverse rendering aims at recovering both geometry and materials of objects. It provides a more compatible reconstruction for conventional rendering engines, compared with the neural radiance fields (NeRFs). On the other…

Inverse RenderingNeRFObject

NeRFMeshing: Distilling Neural Radiance Fields into Geometrically-Accurate 3D Meshes

2023-03-16 · Marie-Julie Rakotosaona, Fabian Manhardt, Diego Martin Arroyo, Michael Niemeyer 외

With the introduction of Neural Radiance Fields (NeRFs), novel view synthesis has recently made a big leap forward. At the core, NeRF proposes that each 3D point can emit radiance, allowing to conduct view synthesis usin…

NeRFNovel View SynthesisSurface Reconstruction

IntrinsicNeRF: Learning Intrinsic Neural Radiance Fields for Editable Novel View Synthesis

2022-10-02 · ICCV 2023 1 · Weicai Ye, Shuo Chen, Chong Bao, Hujun Bao 외

Existing inverse rendering combined with neural rendering methods can only perform editable novel view synthesis on object-specific scenes, while we present intrinsic neural radiance fields, dubbed IntrinsicNeRF, which i…

ClusteringInverse RenderingNeRFNeural Rendering+1

Neural Fields meet Explicit Geometric Representation for Inverse Rendering of Urban Scenes

2023-04-06 · Zian Wang, Tianchang Shen, Jun Gao, Shengyu Huang 외

Reconstruction and intrinsic decomposition of scenes from captured imagery would enable many applications such as relighting and virtual object insertion. Recent NeRF based methods achieve impressive fidelity of 3D recon…

3D ReconstructionInverse RenderingNeRF