paper-with-me

홈 › Papers

DELS-MVS: Deep Epipolar Line Search for Multi-View Stereo

2022-12-13 · Christian Sormann, Emanuele Santellani, Mattia Rossi, Andreas Kuhn, Friedrich Fraundorfer

We propose a novel approach for deep learning-based Multi-View Stereo (MVS). For each pixel in the reference image, our method leverages a deep architecture to search for the corresponding point in the source image directly along the corresponding epipolar line. We denote our method DELS-MVS: Deep Epipolar Line Search Multi-View Stereo. Previous works in deep MVS select a range of interest within the depth space, discretize it, and sample the epipolar line according to the resulting depth values: this can result in an uneven scanning of the epipolar line, hence of the image space. Instead, our method works directly on the epipolar line: this guarantees an even scanning of the image space and avoids both the need to select a depth range of interest, which is often not known a priori and can vary dramatically from scene to scene, and the need for a suitable discretization of the depth space. In fact, our search is iterative, which avoids the building of a cost volume, costly both to store and to process. Finally, our method performs a robust geometry-aware fusion of the estimated depth maps, leveraging a confidence predicted alongside each depth. We test DELS-MVS on the ETH3D, Tanks and Temples and DTU benchmarks and achieve competitive results with respect to state-of-the-art approaches.

📄 PDF Abstract BibTeX arXiv:2212.06626

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

Test 설명 없음

Similar Papers 제목 키워드 기반

When Epipolar Constraint Meets Non-local Operators in Multi-View Stereo

2023-09-29 · ICCV 2023 1 · Tianqi Liu, Xinyi Ye, Weiyue Zhao, Zhiyu Pan 외

Learning-based multi-view stereo (MVS) method heavily relies on feature matching, which requires distinctive and descriptive representations. An effective solution is to apply non-local feature aggregation, e.g., Transfo…

3D ReconstructionDescriptivePoint CloudsStereo Matching

Two view constraints on the epipoles from few correspondences

2018-10-22 · Yoni Kasten, Michael Werman

In general it requires at least 7 point correspondences to compute the fundamental matrix between views. We use the cross ratio invariance between corresponding epipolar lines, stemming from epipolar line homography, to …

Vocal Bursts Valence Prediction

MONET: Multiview Semi-supervised Keypoint Detection via Epipolar Divergence

2018-05-31 · ICCV 2019 10 · Yuan Yao, Yasamin Jafarian, Hyun Soo Park

This paper presents MONET -- an end-to-end semi-supervised learning framework for a keypoint detector using multiview image streams. In particular, we consider general subjects such as non-human species where attaining a…

Data AugmentationKeypoint Detection

Camera Calibration from Dynamic Silhouettes Using Motion Barcodes

2015-06-25 · CVPR 2016 6 · Gil Ben-Artzi, Yoni Kasten, Shmuel Peleg, Michael Werman

Computing the epipolar geometry between cameras with very different viewpoints is often problematic as matching points are hard to find. In these cases, it has been proposed to use information from dynamic objects in the…

Camera Calibration

Fundamental Matrices from Moving Objects Using Line Motion Barcodes

2016-07-26 · Yoni Kasten, Gil Ben-Artzi, Shmuel Peleg, Michael Werman

Computing the epipolar geometry between cameras with very different viewpoints is often very difficult. The appearance of objects can vary greatly, and it is difficult to find corresponding feature points. Prior methods …