Matching entropy based disparity estimation from light field
A major challenge for matching-based depth estimation is to prevent mismatches in occlusion and smooth regions. An effective matching window satisfying three characteristics: texture richness, disparity consistency and anti-occlusion should be able to prevent mismatches to some extent. According to these characteristics, we propose matching entropy in the spatial domain of light field to measure the amount of correct information in a matching window, which provides the criterion for matching window selection. Based on matching entropy regularization, we establish an optimization model for depth estimation with a matching cost fidelity term. To find the optimum, we propose a two-step adaptive matching algorithm. First, the region type is adaptively determined to identify occluding, occluded, smooth and textured regions. Then, the matching entropy criterion is used to adaptively select the size and shape of matching windows, as well as the visible viewpoints. The two-step process can reduce mismatches and redundant calculations by selecting effective matching windows. The experimental results on synthetic and real data show that the proposed method can effectively improve the accuracy of depth estimation in occlusion and smooth regions and has strong robustness for different noise levels. Therefore, high-precision depth estimation from 4D light field data is achieved.
Code (0)
등록된 구현이 없습니다.
Tasks
Depth EstimationDisparity EstimationSimilar Papers 제목 키워드 기반
Frequency-Structured Field Learning for Light-Field Disparity Estimation
Light-field disparity estimation requires global consistency in smooth or textureless regions and local precision near occlusion boundaries, thin structures, and abrupt depth transitions. Existing methods address these r…
Disparity EstimationUnsupervised Light Field Depth Estimation via Multi-view Feature Matching with Occlusion Prediction
Depth estimation from light field (LF) images is a fundamental step for numerous applications. Recently, learning-based methods have achieved higher accuracy and efficiency than the traditional methods. However, it is co…
Depth EstimationDisparity EstimationOcclusion HandlingFast Light-Field Disparity Estimation With Multi-Disparity-Scale Cost Aggregation
Light field images contain both angular and spatial information of captured light rays. The rich information of light fields enables straightforward disparity recovery capability but demands high computational cost a…
Disparity EstimationGPUNoise-Sampling Cross Entropy Loss: Improving Disparity Regression Via Cost Volume Aware Regularizer
Recent end-to-end deep neural networks for disparity regression have achieved the state-of-the-art performance. However, many well-acknowledged specific properties of disparity estimation are omitted in these deep learni…
Disparity EstimationregressionStereo MatchingHyperspectral Light Field Stereo Matching
In this paper, we describe how scene depth can be extracted using a hyperspectral light field capture (H-LF) system. Our H-LF system consists of a 5 x 6 array of cameras, with each camera sampling a different narrow band…
Disparity EstimationStereo MatchingStereo Matching Hand