GC-MVSNet: Multi-View, Multi-Scale, Geometrically-Consistent Multi-View Stereo
Traditional multi-view stereo (MVS) methods rely heavily on photometric and geometric consistency constraints, but newer machine learning-based MVS methods check geometric consistency across multiple source views only as a post-processing step. In this paper, we present a novel approach that explicitly encourages geometric consistency of reference view depth maps across multiple source views at different scales during learning (see Fig. 1). We find that adding this geometric consistency loss significantly accelerates learning by explicitly penalizing geometrically inconsistent pixels, reducing the training iteration requirements to nearly half that of other MVS methods. Our extensive experiments show that our approach achieves a new state-of-the-art on the DTU and BlendedMVS datasets, and competitive results on the Tanks and Temples benchmark. To the best of our knowledge, GC-MVSNet is the first attempt to enforce multi-view, multi-scale geometric consistency during learning.
Code (1)
Tasks
3D ReconstructionMulti-View 3D ReconstructionPoint CloudsSimilar Papers 제목 키워드 기반
Blending 3D Geometry and Machine Learning for Multi-View Stereopsis
Traditional multi-view stereo (MVS) methods primarily depend on photometric and geometric consistency constraints. In contrast, modern learning-based algorithms often rely on the plane sweep algorithm to infer 3D geometr…
3D geometryPyramid Multi-view Stereo Net with Self-adaptive View Aggregation
n this paper, we propose an effective and efficient pyramid multi-view stereo (MVS) net with self-adaptive view aggregation for accurate and complete dense point cloud reconstruction. Different from using mean square var…
3D Point Cloud Reconstruction3D ReconstructionDepth EstimationPoint cloud reconstructionMulti-View Stereo Representation Revisit: Region-Aware MVSNet
Deep learning-based multi-view stereo has emerged as a powerful paradigm for reconstructing the complete geometrically-detailed objects from multi-views. Most of the existing approaches only estimate the pixel-wise depth…
3D ReconstructionPoint CloudsMulti-View Stereo Representation Revist: Region-Aware MVSNet
Deep learning-based multi-view stereo has emerged as a powerful paradigm for reconstructing the complete geometrically-detailed objects from multi-views. Most of the existing approaches only estimate the pixel-wise d…
Recurrent MVSNet for High-resolution Multi-view Stereo Depth Inference
Deep learning has recently demonstrated its excellent performance for multi-view stereo (MVS). However, one major limitation of current learned MVS approaches is the scalability: the memory-consuming cost volume regulari…
Vocal Bursts Intensity Prediction