paper-with-me

홈 › Papers

Learning Relighting and Intrinsic Decomposition in Neural Radiance Fields

2024-06-16 · Yixiong Yang, Shilin Hu, HaoYu Wu, Ramon Baldrich, Dimitris Samaras, Maria Vanrell

The task of extracting intrinsic components, such as reflectance and shading, from neural radiance fields is of growing interest. However, current methods largely focus on synthetic scenes and isolated objects, overlooking the complexities of real scenes with backgrounds. To address this gap, our research introduces a method that combines relighting with intrinsic decomposition. By leveraging light variations in scenes to generate pseudo labels, our method provides guidance for intrinsic decomposition without requiring ground truth data. Our method, grounded in physical constraints, ensures robustness across diverse scene types and reduces the reliance on pre-trained models or hand-crafted priors. We validate our method on both synthetic and real-world datasets, achieving convincing results. Furthermore, the applicability of our method to image editing tasks demonstrates promising outcomes.

📄 PDF Abstract BibTeX arXiv:2406.11077

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

Focus 설명 없음

Similar Papers 제목 키워드 기반

Complementary Intrinsics From Neural Radiance Fields and CNNs for Outdoor Scene Relighting

2023-01-01 · CVPR 2023 1 · Siqi Yang, Xuanning Cui, Yongjie Zhu, Jiajun Tang 외

Relighting an outdoor scene is challenging due to the diverse illuminations and salient cast shadows. Intrinsic image decomposition on outdoor photo collections could partly solve this problem by weakly supervised la…

Intrinsic Image Decomposition

Neural Fields meet Explicit Geometric Representation for Inverse Rendering of Urban Scenes

2023-04-06 · Zian Wang, Tianchang Shen, Jun Gao, Shengyu Huang 외

Reconstruction and intrinsic decomposition of scenes from captured imagery would enable many applications such as relighting and virtual object insertion. Recent NeRF based methods achieve impressive fidelity of 3D recon…

3D ReconstructionInverse RenderingNeRF

Neural Fields Meet Explicit Geometric Representations for Inverse Rendering of Urban Scenes

2023-01-01 · CVPR 2023 1 · Zian Wang, Tianchang Shen, Jun Gao, Shengyu Huang 외

Reconstruction and intrinsic decomposition of scenes from captured imagery would enable many applications such as relighting and virtual object insertion. Recent NeRF based methods achieve impressive fidelity of 3D r…

3D ReconstructionInverse RenderingNeRF

Estimating Neural Reflectance Field from Radiance Field using Tree Structures

2022-10-09 · Xiu Li, Xiao Li, Yan Lu

We present a new method for estimating the Neural Reflectance Field (NReF) of an object from a set of posed multi-view images under unknown lighting. NReF represents 3D geometry and appearance of objects in a disentangle…

3D geometryNeRF

IntrinsicNeRF: Learning Intrinsic Neural Radiance Fields for Editable Novel View Synthesis

2022-10-02 · ICCV 2023 1 · Weicai Ye, Shuo Chen, Chong Bao, Hujun Bao 외

Existing inverse rendering combined with neural rendering methods can only perform editable novel view synthesis on object-specific scenes, while we present intrinsic neural radiance fields, dubbed IntrinsicNeRF, which i…

ClusteringInverse RenderingNeRFNeural Rendering+1