EDNet: Efficient Disparity Estimation with Cost Volume Combination and Attention-based Spatial Residual
Existing state-of-the-art disparity estimation works mostly leverage the 4D concatenation volume and construct a very deep 3D convolution neural network (CNN) for disparity regression, which is inefficient due to the high memory consumption and slow inference speed. In this paper, we propose a network named EDNet for efficient disparity estimation. Firstly, we construct a combined volume which incorporates contextual information from the squeezed concatenation volume and feature similarity measurement from the correlation volume. The combined volume can be next aggregated by 2D convolutions which are faster and require less memory than 3D convolutions. Secondly, we propose an attention-based spatial residual module to generate attention-aware residual features. The attention mechanism is applied to provide intuitive spatial evidence about inaccurate regions with the help of error maps at multiple scales and thus improve the residual learning efficiency. Extensive experiments on the Scene Flow and KITTI datasets show that EDNet outperforms the previous 3D CNN based works and achieves state-of-the-art performance with significantly faster speed and less memory consumption.
Code (0)
등록된 구현이 없습니다.
Tasks
Disparity EstimationStereo MatchingMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Rectified Iterative Disparity for Stereo Matching
Both uncertainty-assisted and iteration-based methods have achieved great success in stereo matching. However, existing uncertainty estimation methods take a single image and the corresponding disparity as input, which i…
Disparity EstimationStereo MatchingPCW-Net: Pyramid Combination and Warping Cost Volume for Stereo Matching
Existing deep learning based stereo matching methods either focus on achieving optimal performances on the target dataset while with poor generalization for other datasets or focus on handling the cross-domain generaliza…
Disparity EstimationDomain GeneralizationStereo MatchingOccCasNet: Occlusion-aware Cascade Cost Volume for Light Field Depth Estimation
Light field (LF) depth estimation is a crucial task with numerous practical applications. However, mainstream methods based on the multi-view stereo (MVS) are resource-intensive and time-consuming as they need to constru…
Depth EstimationDisparity EstimationCFNet: Cascade and Fused Cost Volume for Robust Stereo Matching
Recently, the ever-increasing capacity of large-scale annotated datasets has led to profound progress in stereo matching. However, most of these successes are limited to a specific dataset and cannot generalize well to o…
Disparity EstimationStereo MatchingAMNet: Deep Atrous Multiscale Stereo Disparity Estimation Networks
In this paper, a new deep learning architecture for stereo disparity estimation is proposed. The proposed atrous multiscale network (AMNet) adopts an efficient feature extractor with depthwise-separable convolutions and …
Disparity EstimationStereo Disparity EstimationStereo MatchingStereo Matching Hand