paper-with-me

홈 › Papers

TraM-NeRF: Tracing Mirror and Near-Perfect Specular Reflections through Neural Radiance Fields

2023-10-16 · Leif Van Holland, Ruben Bliersbach, Jan U. Müller, Patrick Stotko, Reinhard Klein

Implicit representations like Neural Radiance Fields (NeRF) showed impressive results for photorealistic rendering of complex scenes with fine details. However, ideal or near-perfectly specular reflecting objects such as mirrors, which are often encountered in various indoor scenes, impose ambiguities and inconsistencies in the representation of the reconstructed scene leading to severe artifacts in the synthesized renderings. In this paper, we present a novel reflection tracing method tailored for the involved volume rendering within NeRF that takes these mirror-like objects into account while avoiding the cost of straightforward but expensive extensions through standard path tracing. By explicitly modeling the reflection behavior using physically plausible materials and estimating the reflected radiance with Monte-Carlo methods within the volume rendering formulation, we derive efficient strategies for importance sampling and the transmittance computation along rays from only few samples. We show that our novel method enables the training of consistent representations of such challenging scenes and achieves superior results in comparison to previous state-of-the-art approaches.

📄 PDF Abstract BibTeX arXiv:2310.10650

Code (1)

Rubikalubi/TraM-NeRF 공식 구현 pytorch

Tasks

NeRF

Similar Papers 제목 키워드 기반

Mirror-NeRF: Learning Neural Radiance Fields for Mirrors with Whitted-Style Ray Tracing

2023-08-07 · Junyi Zeng, Chong Bao, Rui Chen, Zilong Dong 외

Recently, Neural Radiance Fields (NeRF) has exhibited significant success in novel view synthesis, surface reconstruction, etc. However, since no physical reflection is considered in its rendering pipeline, NeRF mistakes…

NeRFNeural RenderingNovel View SynthesisSurface Reconstruction

Gaussian Splatting in Mirrors: Reflection-Aware Rendering via Virtual Camera Optimization

2024-10-02 · Zihan Wang, Shuzhe Wang, Matias Turkulainen, Junyuan Fang 외

Recent advancements in 3D Gaussian Splatting (3D-GS) have revolutionized novel view synthesis, facilitating real-time, high-quality image rendering. However, in scenarios involving reflective surfaces, particularly mirro…

NeRFNovel View Synthesis

NeRFs are Mirror Detectors: Using Structural Similarity for Multi-View Mirror Scene Reconstruction with 3D Surface Primitives

2025-01-07 · Leif Van Holland, Michael Weinmann, Jan U. Müller, Patrick Stotko 외

While neural radiance fields (NeRF) led to a breakthrough in photorealistic novel view synthesis, handling mirroring surfaces still denotes a particular challenge as they introduce severe inconsistencies in the scene rep…

NeRFNovel View Synthesis

"Mirror" Language AI Models of Depression are Criterion-Contaminated

2025-08-07 · Tong Li, Rasiq Hussain, Mehak Gupta, Joshua R. Oltmanns arxiv

Recent studies show near-perfect language-based predictions of depression scores (R2 = .70), but these "Mirror" models rely on language responses directly from depression assessments to predict depression assessment scor…

Mirror-3DGS: Incorporating Mirror Reflections into 3D Gaussian Splatting

2024-04-01 · Jiarui Meng, Haijie Li, Yanmin Wu, Qiankun Gao 외

3D Gaussian Splatting (3DGS) has significantly advanced 3D scene reconstruction and novel view synthesis. However, like Neural Radiance Fields (NeRF), 3DGS struggles with accurately modeling physical reflections, particu…

3DGS3D Scene ReconstructionNeRFNovel View Synthesis