Multi-View Guided Multi-View Stereo
This paper introduces a novel deep framework for dense 3D reconstruction from multiple image frames, leveraging a sparse set of depth measurements gathered jointly with image acquisition. Given a deep multi-view stereo network, our framework uses sparse depth hints to guide the neural network by modulating the plane-sweep cost volume built during the forward step, enabling us to infer constantly much more accurate depth maps. Moreover, since multiple viewpoints can provide additional depth measurements, we propose a multi-view guidance strategy that increases the density of the sparse points used to guide the network, thus leading to even more accurate results. We evaluate our Multi-View Guided framework within a variety of state-of-the-art deep multi-view stereo networks, demonstrating its effectiveness at improving the results achieved by each of them on BlendedMVG and DTU datasets.
Code (1)
Tasks
3D ReconstructionSimilar Papers 제목 키워드 기반
Generalizable Novel-View Synthesis using a Stereo Camera
In this paper, we propose the first generalizable view synthesis approach that specifically targets multi-view stereo-camera images. Since recent stereo matching has demonstrated accurate geometry prediction, we introduc…
Generalizable Novel View SynthesisNeRFNovel View SynthesisStereo MatchingMulti-Scale Geometric Consistency Guided Multi-View Stereo
In this paper, we propose an efficient multi-scale geometric consistency guided multi-view stereo method for accurate and complete depth map estimation. We first present our basic multi-view stereo method with Adaptive C…
Depth EstimationMulti-View 3D ReconstructionPoint CloudsNeural Multi-View Self-Calibrated Photometric Stereo without Photometric Stereo Cues
We propose a neural inverse rendering approach that jointly reconstructs geometry, spatially varying reflectance, and lighting conditions from multi-view images captured under varying directional lighting. Unlike prior m…
Inverse RenderingNeVStereo: A NeRF-Driven NVS-Stereo Architecture for High-Fidelity 3D Tasks
In modern dense 3D reconstruction, feed-forward systems (e.g., VGGT, pi3) focus on end-to-end matching and geometry prediction but do not explicitly output the novel view synthesis (NVS). Neural rendering-based approache…
Novel View Synthesis3D ReconstructionDepth EstimationMeshMVS: Multi-View Stereo Guided Mesh Reconstruction
Deep learning based 3D shape generation methods generally utilize latent features extracted from color images to encode the semantics of objects and guide the shape generation process. These color image semantics only im…
3D Shape Generation