paper-with-me

홈 › Papers

Planar Reflection-Aware Neural Radiance Fields

2024-11-07 · Chen Gao, Yipeng Wang, Changil Kim, Jia-Bin Huang, Johannes Kopf

Neural Radiance Fields (NeRF) have demonstrated exceptional capabilities in reconstructing complex scenes with high fidelity. However, NeRF's view dependency can only handle low-frequency reflections. It falls short when handling complex planar reflections, often interpreting them as erroneous scene geometries and leading to duplicated and inaccurate scene representations. To address this challenge, we introduce a reflection-aware NeRF that jointly models planar reflectors, such as windows, and explicitly casts reflected rays to capture the source of the high-frequency reflections. We query a single radiance field to render the primary color and the source of the reflection. We propose a sparse edge regularization to help utilize the true sources of reflections for rendering planar reflections rather than creating a duplicate along the primary ray at the same depth. As a result, we obtain accurate scene geometry. Rendering along the primary ray results in a clean, reflection-free view, while explicitly rendering along the reflected ray allows us to reconstruct highly detailed reflections. Our extensive quantitative and qualitative evaluations of real-world datasets demonstrate our method's enhanced performance in accurately handling reflections.

📄 PDF Abstract BibTeX arXiv:2411.04984

Code (0)

등록된 구현이 없습니다.

Tasks

NeRF

Similar Papers 제목 키워드 기반

NeRFReN: Neural Radiance Fields with Reflections

2021-11-30 · CVPR 2022 1 · Yuan-Chen Guo, Di Kang, Linchao Bao, Yu He 외

Neural Radiance Fields (NeRF) has achieved unprecedented view synthesis quality using coordinate-based neural scene representations. However, NeRF's view dependency can only handle simple reflections like highlights but …

Depth EstimationNeRFNovel View Synthesis

Mirror-NeRF: Learning Neural Radiance Fields for Mirrors with Whitted-Style Ray Tracing

2023-08-07 · Junyi Zeng, Chong Bao, Rui Chen, Zilong Dong 외

Recently, Neural Radiance Fields (NeRF) has exhibited significant success in novel view synthesis, surface reconstruction, etc. However, since no physical reflection is considered in its rendering pipeline, NeRF mistakes…

NeRFNeural RenderingNovel View SynthesisSurface Reconstruction

Planar Gaussian Splatting with Bilinear Spatial Transformer for Wireless Radiance Field Reconstruction

2026-04-17 · Jinghan Zhang, Xitao Gong, Qi Wang, Richard A. Stirling-Gallacher 외 arxiv

Wireless radiance field (WRF) reconstruction aims to learn a continuous, queryable representation of radio frequency characteristics over 3D space and direction, from which specific quantities, such as the spatial power …

ORCa: Glossy Objects as Radiance Field Cameras

2022-12-08 · Kushagra Tiwary, Akshat Dave, Nikhil Behari, Tzofi Klinghoffer 외

Reflections on glossy objects contain valuable and hidden information about the surrounding environment. By converting these objects into cameras, we can unlock exciting applications, including imaging beyond the camera'…

Novel View SynthesisObject

ORCa: Glossy Objects As Radiance-Field Cameras

2023-01-01 · CVPR 2023 1 · Kushagra Tiwary, Akshat Dave, Nikhil Behari, Tzofi Klinghoffer 외

Reflections on glossy objects contain valuable and hidden information about the surrounding environment. By converting these objects into cameras, we can unlock exciting applications, including imaging beyond the cam…

Novel View SynthesisObject