paper-with-me

Papers

MP-MVS: Multi-Scale Windows PatchMatch and Planar Prior Multi-View Stereo

2023-09-23 · Rongxuan Tan, Qing Wang, Xueyan Wang, Chao Yan, Yang Sun, Youyang Feng

Significant strides have been made in enhancing the accuracy of Multi-View Stereo (MVS)-based 3D reconstruction. However, untextured areas with unstable photometric consistency often remain incompletely reconstructed. In this paper, we propose a resilient and effective multi-view stereo approach (MP-MVS). We design a multi-scale windows PatchMatch (mPM) to obtain reliable depth of untextured areas. In contrast with other multi-scale approaches, which is faster and can be easily extended to PatchMatch-based MVS approaches. Subsequently, we improve the existing checkerboard sampling schemes by limiting our sampling to distant regions, which can effectively improve the efficiency of spatial propagation while mitigating outlier generation. Finally, we introduce and improve planar prior assisted PatchMatch of ACMP. Instead of relying on photometric consistency, we utilize geometric consistency information between multi-views to select reliable triangulated vertices. This strategy can obtain a more accurate planar prior model to rectify photometric consistency measurements. Our approach has been tested on the ETH3D High-res multi-view benchmark with several state-of-the-art approaches. The results demonstrate that our approach can reach the state-of-the-art. The associated codes will be accessible at https://github.com/RongxuanTan/MP-MVS.

📄 PDF Abstract BibTeX arXiv:2309.13294

Code (1)

rongxuantan/mp-mvs 공식 구현

Tasks

3D Reconstruction

Methods 이 논문이 사용한 방법론

Spatial Propagation Inspired by the spatial propagation mechanism utilized in the depth completion task \cite{NLSPN}, we introduce a normal incorporated non-local disparity propagation module in…

Similar Papers 제목 키워드 기반

Planar Prior Assisted PatchMatch Multi-View Stereo

2019-12-26 · Qingshan Xu, Wenbing Tao

The completeness of 3D models is still a challenging problem in multi-view stereo (MVS) due to the unreliable photometric consistency in low-textured areas. Since low-textured areas usually exhibit strong planarity, plan…

Depth EstimationMulti-View 3D Reconstruction

Polarimetric PatchMatch Multi-View Stereo

2023-11-11 · Jinyu Zhao, Jumpei Oishi, Yusuke Monno, Masatoshi Okutomi

PatchMatch Multi-View Stereo (PatchMatch MVS) is one of the popular MVS approaches, owing to its balanced accuracy and efficiency. In this paper, we propose Polarimetric PatchMatch multi-view Stereo (PolarPMS), which is …

Stereo Matching

Deep PatchMatch MVS with Learned Patch Coplanarity, Geometric Consistency and Adaptive Pixel Sampling

2022-10-14 · Jae Yong Lee, Chuhang Zou, Derek Hoiem

Recent work in multi-view stereo (MVS) combines learnable photometric scores and regularization with PatchMatch-based optimization to achieve robust pixelwise estimates of depth, normals, and visibility. However, non-lea…

TAPA-MVS: Textureless-Aware PAtchMatch Multi-View Stereo

2019-03-26 · ICCV 2019 10 · Andrea Romanoni, Matteo Matteucci

One of the most successful approaches in Multi-View Stereo estimates a depth map and a normal map for each view via PatchMatch-based optimization and fuses them into a consistent 3D points cloud. This approach relies on …

PatchmatchNet: Learned Multi-View Patchmatch Stereo

2020-12-02 · CVPR 2021 1 · Fangjinhua Wang, Silvano Galliani, Christoph Vogel, Pablo Speciale 외

We present PatchmatchNet, a novel and learnable cascade formulation of Patchmatch for high-resolution multi-view stereo. With high computation speed and low memory requirement, PatchmatchNet can process higher resolution…

3D ReconstructionPoint Clouds