PMNI: Pose-free Multi-view Normal Integration for Reflective and Textureless Surface Reconstruction
Reflective and textureless surfaces remain a challenge in multi-view 3D reconstruction.Both camera pose calibration and shape reconstruction often fail due to insufficient or unreliable cross-view visual features. To address these issues, we present PMNI (Pose-free Multi-view Normal Integration), a neural surface reconstruction method that incorporates rich geometric information by leveraging surface normal maps instead of RGB images. By enforcing geometric constraints from surface normals and multi-view shape consistency within a neural signed distance function (SDF) optimization framework, PMNI simultaneously recovers accurate camera poses and high-fidelity surface geometry. Experimental results on synthetic and real-world datasets show that our method achieves state-of-the-art performance in the reconstruction of reflective surfaces, even without reliable initial camera poses.
Code (1)
Tasks
Surface ReconstructionSimilar Papers 제목 키워드 기반
The unreasonable effectiveness of the forget gate
Given the success of the gated recurrent unit, a natural question is whether all the gates of the long short-term memory (LSTM) network are necessary. Previous research has shown that the forget gate is one of the most i…
VT-3DAD: Cross-Category 3D Anomaly Detection via Visual-Text Normal Space Alignment
Few-shot cross-category 3D anomaly detection aims to determine whether an unknown point cloud belongs to a target normal category using only a few normal references. Existing training-based methods usually require catego…
3D Anomaly DetectionFree3D: Consistent Novel View Synthesis without 3D Representation
We introduce Free3D, a simple accurate method for monocular open-set novel view synthesis (NVS). Similar to Zero-1-to-3, we start from a pre-trained 2D image generator for generalization, and fine-tune it for NVS. Compar…
3D ReconstructionNovel View SynthesisFreeness in cognitive science
In this mini-review, dedicated to the Jubilee of Professor Tadeusz Marek, we highlight in a popular way the power of so-called free random variables (hereafter FRV) calculus, viewed as a potential probability calculus fo…
Make Your MoVe: Make Your 3D Contents by Adapting Multi-View Diffusion Models to External Editing
As 3D generation techniques continue to flourish, the demand for generating personalized content is rapidly rising. Users increasingly seek to apply various editing methods to polish generated 3D content, aiming to enhan…
3D Generation