paper-with-me

홈 › Papers

Ref-NeuS: Ambiguity-Reduced Neural Implicit Surface Learning for Multi-View Reconstruction with Reflection

2023-03-20 · ICCV 2023 1 · Wenhang Ge, Tao Hu, Haoyu Zhao, Shu Liu, Ying-Cong Chen

Neural implicit surface learning has shown significant progress in multi-view 3D reconstruction, where an object is represented by multilayer perceptrons that provide continuous implicit surface representation and view-dependent radiance. However, current methods often fail to accurately reconstruct reflective surfaces, leading to severe ambiguity. To overcome this issue, we propose Ref-NeuS, which aims to reduce ambiguity by attenuating the effect of reflective surfaces. Specifically, we utilize an anomaly detector to estimate an explicit reflection score with the guidance of multi-view context to localize reflective surfaces. Afterward, we design a reflection-aware photometric loss that adaptively reduces ambiguity by modeling rendered color as a Gaussian distribution, with the reflection score representing the variance. We show that together with a reflection direction-dependent radiance, our model achieves high-quality surface reconstruction on reflective surfaces and outperforms the state-of-the-arts by a large margin. Besides, our model is also comparable on general surfaces.

📄 PDF Abstract BibTeX arXiv:2303.10840

Code (1)

EnVision-Research/Ref-NeuS 공식 구현 pytorch

Tasks

3D ReconstructionMulti-View 3D ReconstructionSurface Reconstruction

Methods 이 논문이 사용한 방법론

fail 설명 없음

Similar Papers 제목 키워드 기반

Looking Through the Glass: Neural Surface Reconstruction Against High Specular Reflections

2023-04-18 · CVPR 2023 1 · Jiaxiong Qiu, Peng-Tao Jiang, Yifan Zhu, Ze-Xin Yin 외

Neural implicit methods have achieved high-quality 3D object surfaces under slight specular highlights. However, high specular reflections (HSR) often appear in front of target objects when we capture them through glasse…

Neural RenderingObjectSurface ReconstructionVocal Bursts Intensity Prediction

Recovering Fine Details for Neural Implicit Surface Reconstruction

2022-11-21 · Decai Chen, Peng Zhang, Ingo Feldmann, Oliver Schreer 외

Recent works on implicit neural representations have made significant strides. Learning implicit neural surfaces using volume rendering has gained popularity in multi-view reconstruction without 3D supervision. However, …

Surface Reconstruction

SERES: Semantic-aware neural reconstruction from sparse views

2025-08-23 · Bo Xu, Yuhu Guo, Yuchao Wang, Wenting Wang 외 arxiv

We propose a semantic-aware neural reconstruction method to generate 3D high-fidelity models from sparse images. To tackle the challenge of severe radiance ambiguity caused by mismatched features in sparse input, we enri…

NeuS-PIR: Learning Relightable Neural Surface using Pre-Integrated Rendering

2023-06-13 · Shi Mao, Chenming Wu, Zhelun Shen, Yifan Wang 외

This paper presents a method, namely NeuS-PIR, for recovering relightable neural surfaces using pre-integrated rendering from multi-view images or video. Unlike methods based on NeRF and discrete meshes, our method utili…

DisentanglementNeRF

Depth-NeuS: Neural Implicit Surfaces Learning for Multi-view Reconstruction Based on Depth Information Optimization

2023-03-30 · Hanqi Jiang, Cheng Zeng, Runnan Chen, Shuai Liang 외

Recently, methods for neural surface representation and rendering, for example NeuS, have shown that learning neural implicit surfaces through volume rendering is becoming increasingly popular and making good progress. H…

Object ReconstructionSurface Reconstruction