paper-with-me

홈 › Papers

Reflections Unlock: Geometry-Aware Reflection Disentanglement in 3D Gaussian Splatting for Photorealistic Scenes Rendering

2025-07-08 · Jiayi Song, Zihan Ye, Qingyuan Zhou, Weidong Yang, Ben Fei, Jingyi Xu, Ying He, Wanli Ouyang

Accurately rendering scenes with reflective surfaces remains a significant challenge in novel view synthesis, as existing methods like Neural Radiance Fields (NeRF) and 3D Gaussian Splatting (3DGS) often misinterpret reflections as physical geometry, resulting in degraded reconstructions. Previous methods rely on incomplete and non-generalizable geometric constraints, leading to misalignment between the positions of Gaussian splats and the actual scene geometry. When dealing with real-world scenes containing complex geometry, the accumulation of Gaussians further exacerbates surface artifacts and results in blurred reconstructions. To address these limitations, in this work, we propose Ref-Unlock, a novel geometry-aware reflection modeling framework based on 3D Gaussian Splatting, which explicitly disentangles transmitted and reflected components to better capture complex reflections and enhance geometric consistency in real-world scenes. Our approach employs a dual-branch representation with high-order spherical harmonics to capture high-frequency reflective details, alongside a reflection removal module providing pseudo reflection-free supervision to guide clean decomposition. Additionally, we incorporate pseudo-depth maps and a geometry-aware bilateral smoothness constraint to enhance 3D geometric consistency and stability in decomposition. Extensive experiments demonstrate that Ref-Unlock significantly outperforms classical GS-based reflection methods and achieves competitive results with NeRF-based models, while enabling flexible vision foundation models (VFMs) driven reflection editing. Our method thus offers an efficient and generalizable solution for realistic rendering of reflective scenes. Our code is available at https://ref-unlock.github.io/.

📄 PDF Abstract BibTeX arXiv:2507.06103

Code (0)

등록된 구현이 없습니다.

Tasks

3DGSDisentanglementNeRFNovel View SynthesisReflection Removal

Similar Papers 제목 키워드 기반

ORCa: Glossy Objects as Radiance Field Cameras

2022-12-08 · Kushagra Tiwary, Akshat Dave, Nikhil Behari, Tzofi Klinghoffer 외

Reflections on glossy objects contain valuable and hidden information about the surrounding environment. By converting these objects into cameras, we can unlock exciting applications, including imaging beyond the camera'…

Novel View SynthesisObject

ORCa: Glossy Objects As Radiance-Field Cameras

2023-01-01 · CVPR 2023 1 · Kushagra Tiwary, Akshat Dave, Nikhil Behari, Tzofi Klinghoffer 외

Reflections on glossy objects contain valuable and hidden information about the surrounding environment. By converting these objects into cameras, we can unlock exciting applications, including imaging beyond the cam…

Novel View SynthesisObject

Multi-times Monte Carlo Rendering for Inter-reflection Reconstruction

2024-07-08 · Tengjie Zhu, Zhuo Chen, Jingnan Gao, Yichao Yan 외

Inverse rendering methods have achieved remarkable performance in reconstructing high-fidelity 3D objects with disentangled geometries, materials, and environmental light. However, they still face huge challenges in refl…

DisentanglementInverse RenderingSurface Reconstruction

Planar Reflection-Aware Neural Radiance Fields

2024-11-07 · Chen Gao, Yipeng Wang, Changil Kim, Jia-Bin Huang 외

Neural Radiance Fields (NeRF) have demonstrated exceptional capabilities in reconstructing complex scenes with high fidelity. However, NeRF's view dependency can only handle low-frequency reflections. It falls short when…

NeRF

SSR-GS: Separating Specular Reflection in Gaussian Splatting for Glossy Surface Reconstruction

2026-03-05 · Ningjing Fan, Yiqun Wang arxiv

In recent years, 3D Gaussian splatting (3DGS) has achieved remarkable progress in novel view synthesis. However, accurately reconstructing glossy surfaces under complex illumination remains challenging, particularly in s…

Novel View Synthesis