Continuous Cost Aggregation for Dual-Pixel Disparity Extraction
Recent works have shown that depth information can be obtained from Dual-Pixel (DP) sensors. A DP arrangement provides two views in a single shot, thus resembling a stereo image pair with a tiny baseline. However, the different point spread function (PSF) per view, as well as the small disparity range, makes the use of typical stereo matching algorithms problematic. To address the above shortcomings, we propose a Continuous Cost Aggregation (CCA) scheme within a semi-global matching framework that is able to provide accurate continuous disparities from DP images. The proposed algorithm fits parabolas to matching costs and aggregates parabola coefficients along image paths. The aggregation step is performed subject to a quadratic constraint that not only enforces the disparity smoothness but also maintains the quadratic form of the total costs. This gives rise to an inherently efficient disparity propagation scheme with a pixel-wise minimization in closed-form. Furthermore, the continuous form allows for a robust multi-scale aggregation that better compensates for the varying PSF. Experiments on DP data from both DSLR and phone cameras show that the proposed scheme attains state-of-the-art performance in DP disparity estimation.
Code (0)
등록된 구현이 없습니다.
Tasks
Disparity EstimationFormStereo MatchingSimilar Papers 제목 키워드 기반
Stereo Matching with Cost Volume based Sparse Disparity Propagation
Stereo matching is crucial for binocular stereo vision. Existing methods mainly focus on simple disparity map fusion to improve stereo matching, which require multiple dense or sparse disparity maps. In this paper, we pr…
Stereo MatchingGraph Cut based Continuous Stereo Matching using Locally Shared Labels
We present an accurate and efficient stereo matching method using locally shared labels, a new labeling scheme that enables spatial propagation in MRF inference using graph cuts. They give each pixel and region a set of …
Disparity EstimationStereo MatchingStereo Matching HandSpatio-Focal Bidirectional Disparity Estimation From a Dual-Pixel Image
Dual-pixel photography is monocular RGB-D photography with an ultra-high resolution, enabling many applications in computational photography. However, there are still several challenges to fully utilizing dual-pixel …
Depth EstimationDisparity EstimationSelf-Supervised LearningObject-Centric Stereo Ranging for Autonomous Driving: From Dense Disparity to Census-Based Template Matching
Accurate depth estimation is critical for autonomous driving perception systems, particularly for long range vehicle detection on highways. Traditional dense stereo matching methods such as Block Matching (BM) and Semi G…
Autonomous DrivingDepth EstimationSegment-Tree Based Cost Aggregation for Stereo Matching
This paper presents a novel tree-based cost aggregation method for dense stereo matching. Instead of employing the minimum spanning tree (MST) and its variants, a new tree structure, "Segment-Tree", is proposed for non-l…
Scene SegmentationStereo MatchingStereo Matching Hand