RC-MVSNet: Unsupervised Multi-View Stereo with Neural Rendering
Finding accurate correspondences among different views is the Achilles' heel of unsupervised Multi-View Stereo (MVS). Existing methods are built upon the assumption that corresponding pixels share similar photometric features. However, multi-view images in real scenarios observe non-Lambertian surfaces and experience occlusions. In this work, we propose a novel approach with neural rendering (RC-MVSNet) to solve such ambiguity issues of correspondences among views. Specifically, we impose a depth rendering consistency loss to constrain the geometry features close to the object surface to alleviate occlusions. Concurrently, we introduce a reference view synthesis loss to generate consistent supervision, even for non-Lambertian surfaces. Extensive experiments on DTU and Tanks\&Temples benchmarks demonstrate that our RC-MVSNet approach achieves state-of-the-art performance over unsupervised MVS frameworks and competitive performance to many supervised methods.The code is released at https://github.com/Boese0601/RC-MVSNet
Code (1)
Tasks
Neural RenderingSimilar Papers 제목 키워드 기반
Recurrent MVSNet for High-resolution Multi-view Stereo Depth Inference
Deep learning has recently demonstrated its excellent performance for multi-view stereo (MVS). However, one major limitation of current learned MVS approaches is the scalability: the memory-consuming cost volume regulari…
Vocal Bursts Intensity PredictionP-MVSNet: Learning Patch-Wise Matching Confidence Aggregation for Multi-View Stereo
Learning-based methods are demonstrating their strong competitiveness in estimating depth for multi-view stereo reconstruction in recent years. Among them the approaches that generate cost volumes based on the plane-swee…
CL-MVSNet: Unsupervised Multi-View Stereo with Dual-Level Contrastive Learning
Unsupervised Multi-View Stereo (MVS) methods have achieved promising progress recently. However, previous methods primarily depend on the photometric consistency assumption, which may suffer from two limitations: ind…
3D geometryContrastive LearningDepth EstimationDS-MVSNet: Unsupervised Multi-view Stereo via Depth Synthesis
In recent years, supervised or unsupervised learning-based MVS methods achieved excellent performance compared with traditional methods. However, these methods only use the probability volume computed by cost volume regu…
Pyramid Multi-view Stereo Net with Self-adaptive View Aggregation
n this paper, we propose an effective and efficient pyramid multi-view stereo (MVS) net with self-adaptive view aggregation for accurate and complete dense point cloud reconstruction. Different from using mean square var…
3D Point Cloud Reconstruction3D ReconstructionDepth EstimationPoint cloud reconstruction