paper-with-me

홈 › Papers

DeepPruner: Learning Efficient Stereo Matching via Differentiable PatchMatch

2019-09-12 · ICCV 2019 10 · Shivam Duggal, Shenlong Wang, Wei-Chiu Ma, Rui Hu, Raquel Urtasun

Our goal is to significantly speed up the runtime of current state-of-the-art stereo algorithms to enable real-time inference. Towards this goal, we developed a differentiable PatchMatch module that allows us to discard most disparities without requiring full cost volume evaluation. We then exploit this representation to learn which range to prune for each pixel. By progressively reducing the search space and effectively propagating such information, we are able to efficiently compute the cost volume for high likelihood hypotheses and achieve savings in both memory and computation. Finally, an image guided refinement module is exploited to further improve the performance. Since all our components are differentiable, the full network can be trained end-to-end. Our experiments show that our method achieves competitive results on KITTI and SceneFlow datasets while running in real-time at 62ms.

📄 PDF Abstract BibTeX arXiv:1909.05845

Code (1)

uber-research/DeepPruner pytorch

Tasks

Stereo MatchingStereo Matching Hand

Methods 이 논문이 사용한 방법론

SPEED The monocular depth estimation (MDE) is the task of estimating depth from a single frame. This information is an essential knowledge in many computer vision tasks such as scene…

Similar Papers 제목 키워드 기반

Polarimetric PatchMatch Multi-View Stereo

2023-11-11 · Jinyu Zhao, Jumpei Oishi, Yusuke Monno, Masatoshi Okutomi

PatchMatch Multi-View Stereo (PatchMatch MVS) is one of the popular MVS approaches, owing to its balanced accuracy and efficiency. In this paper, we propose Polarimetric PatchMatch multi-view Stereo (PolarPMS), which is …

Stereo Matching

Planar Prior Assisted PatchMatch Multi-View Stereo

2019-12-26 · Qingshan Xu, Wenbing Tao

The completeness of 3D models is still a challenging problem in multi-view stereo (MVS) due to the unreliable photometric consistency in low-textured areas. Since low-textured areas usually exhibit strong planarity, plan…

Depth EstimationMulti-View 3D Reconstruction

MARMVS: Matching Ambiguity Reduced Multiple View Stereo for Efficient Large Scale Scene Reconstruction

2020-06-01 · CVPR 2020 6 · Zhenyu Xu, Yiguang Liu, Xuelei Shi, Ying Wang 외

The ambiguity in image matching is one of main factors decreasing the quality of the 3D model reconstructed by PatchMatch based multiple view stereo. In this paper, we present a novel method, matching ambiguity reduced m…

PatchmatchNet: Learned Multi-View Patchmatch Stereo

2020-12-02 · CVPR 2021 1 · Fangjinhua Wang, Silvano Galliani, Christoph Vogel, Pablo Speciale 외

We present PatchmatchNet, a novel and learnable cascade formulation of Patchmatch for high-resolution multi-view stereo. With high computation speed and low memory requirement, PatchmatchNet can process higher resolution…

3D ReconstructionPoint Clouds

Adaptive Patch Deformation for Textureless-Resilient Multi-View Stereo

2023-01-01 · CVPR 2023 1 · Yuesong Wang, Zhaojie Zeng, Tao Guan, Wei Yang 외

In recent years, deep learning-based approaches have shown great strength in multi-view stereo because of their outstanding ability to extract robust visual features. However, most learning-based methods need to buil…

Multi-View 3D ReconstructionPoint Clouds