paper-with-me

홈 › Papers

PG-NeuS: Robust and Efficient Point Guidance for Multi-View Neural Surface Reconstruction

2023-10-12 · Chen Zhang, Wanjuan Su, Qingshan Xu, Wenbing Tao

Recently, learning multi-view neural surface reconstruction with the supervision of point clouds or depth maps has been a promising way. However, due to the underutilization of prior information, current methods still struggle with the challenges of limited accuracy and excessive time complexity. In addition, prior data perturbation is also an important but rarely considered issue. To address these challenges, we propose a novel point-guided method named PG-NeuS, which achieves accurate and efficient reconstruction while robustly coping with point noise. Specifically, aleatoric uncertainty of the point cloud is modeled to capture the distribution of noise, leading to noise robustness. Furthermore, a Neural Projection module connecting points and images is proposed to add geometric constraints to implicit surface, achieving precise point guidance. To better compensate for geometric bias between volume rendering and point modeling, high-fidelity points are filtered into a Bias Network to further improve details representation. Benefiting from the effective point guidance, even with a lightweight network, the proposed PG-NeuS achieves fast convergence with an impressive 11x speedup compared to NeuS. Extensive experiments show that our method yields high-quality surfaces with high efficiency, especially for fine-grained details and smooth regions, outperforming the state-of-the-art methods. Moreover, it exhibits strong robustness to noisy data and sparse data.

📄 PDF Abstract BibTeX arXiv:2310.07997

Code (0)

등록된 구현이 없습니다.

Tasks

Surface Reconstruction

Similar Papers 제목 키워드 기반

SC-NeuS: Consistent Neural Surface Reconstruction from Sparse and Noisy Views

2023-07-12 · Shi-Sheng Huang, Zi-Xin Zou, Yi-Chi Zhang, Hua Huang

The recent neural surface reconstruction by volume rendering approaches have made much progress by achieving impressive surface reconstruction quality, but are still limited to dense and highly accurate posed views. To o…

Surface Reconstruction

Ref-NeuS: Ambiguity-Reduced Neural Implicit Surface Learning for Multi-View Reconstruction with Reflection

2023-03-20 · ICCV 2023 1 · Wenhang Ge, Tao Hu, Haoyu Zhao, Shu Liu 외

Neural implicit surface learning has shown significant progress in multi-view 3D reconstruction, where an object is represented by multilayer perceptrons that provide continuous implicit surface representation and view-d…

3D ReconstructionMulti-View 3D ReconstructionSurface Reconstruction

NeuSG: Neural Implicit Surface Reconstruction with 3D Gaussian Splatting Guidance

2023-12-01 · Hanlin Chen, Chen Li, Gim Hee Lee

Existing neural implicit surface reconstruction methods have achieved impressive performance in multi-view 3D reconstruction by leveraging explicit geometry priors such as depth maps or point clouds as regularization. Ho…

3D ReconstructionMulti-View 3D ReconstructionSurface Reconstruction

MVCPS-NeuS: Multi-view Constrained Photometric Stereo for Neural Surface Reconstruction

2024-01-01 · CVPR 2024 1 · Hiroaki Santo, Fumio Okura, Yasuyuki Matsushita

Multi-view photometric stereo (MVPS) recovers a high-fidelity 3D shape of a scene by benefiting from both multi-view stereo and photometric stereo. While photometric stereo boosts detailed shape reconstruction it nec…

Surface Reconstruction

Recovering Fine Details for Neural Implicit Surface Reconstruction

2022-11-21 · Decai Chen, Peng Zhang, Ingo Feldmann, Oliver Schreer 외

Recent works on implicit neural representations have made significant strides. Learning implicit neural surfaces using volume rendering has gained popularity in multi-view reconstruction without 3D supervision. However, …

Surface Reconstruction