paper-with-me

Papers

Direct Depth Learning Network for Stereo Matching

2020-12-10 · Hong Zhang, Haojie Li, Shenglun Chen, Tiantian Yan, Zhihui Wang, Guo Lu, Wanli Ouyang

Being a crucial task of autonomous driving, Stereo matching has made great progress in recent years. Existing stereo matching methods estimate disparity instead of depth. They treat the disparity errors as the evaluation metric of the depth estimation errors, since the depth can be calculated from the disparity according to the triangulation principle. However, we find that the error of the depth depends not only on the error of the disparity but also on the depth range of the points. Therefore, even if the disparity error is low, the depth error is still large, especially for the distant points. In this paper, a novel Direct Depth Learning Network (DDL-Net) is designed for stereo matching. DDL-Net consists of two stages: the Coarse Depth Estimation stage and the Adaptive-Grained Depth Refinement stage, which are all supervised by depth instead of disparity. Specifically, Coarse Depth Estimation stage uniformly samples the matching candidates according to depth range to construct cost volume and output coarse depth. Adaptive-Grained Depth Refinement stage performs further matching near the coarse depth to correct the imprecise matching and wrong matching. To make the Adaptive-Grained Depth Refinement stage robust to the coarse depth and adaptive to the depth range of the points, the Granularity Uncertainty is introduced to Adaptive-Grained Depth Refinement stage. Granularity Uncertainty adjusts the matching range and selects the candidates' features according to coarse prediction confidence and depth range. We verify the performance of DDL-Net on SceneFlow dataset and DrivingStereo dataset by different depth metrics. Results show that DDL-Net achieves an average improvement of 25% on the SceneFlow dataset and $12\%$ on the DrivingStereo dataset comparing the classical methods. More importantly, we achieve state-of-the-art accuracy at a large distance.

📄 PDF Abstract BibTeX arXiv:2012.05570

Code (0)

등록된 구현이 없습니다.

Tasks

Autonomous DrivingDepth EstimationStereo Matching

Similar Papers 제목 키워드 기반

Boosting Omnidirectional Stereo Matching with a Pre-trained Depth Foundation Model

2025-03-30 · Jannik Endres, Oliver Hahn, Charles Corbière, Simone Schaub-Meyer 외

Omnidirectional depth perception is essential for mobile robotics applications that require scene understanding across a full 360{\deg} field of view. Camera-based setups offer a cost-effective option by using stereo dep…

Depth EstimationMonocular Depth EstimationOmnnidirectional Stereo Depth EstimationScene Understanding+2

MCPDepth: Omnidirectional Depth Estimation via Stereo Matching from Multi-Cylindrical Panoramas

2024-08-03 · Feng Qiao, Zhexiao Xiong, Xinge Zhu, Yuexin Ma 외

We introduce Multi-Cylindrical Panoramic Depth Estimation (MCPDepth), a two-stage framework for omnidirectional depth estimation via stereo matching between multiple cylindrical panoramas. MCPDepth uses cylindrical panor…

Depth EstimationStereo Matching

3D LiDAR and Stereo Fusion using Stereo Matching Network with Conditional Cost Volume Normalization

2019-04-05 · Tsun-Hsuan Wang, Hou-Ning Hu, Chieh Hubert Lin, Yi-Hsuan Tsai 외

The complementary characteristics of active and passive depth sensing techniques motivate the fusion of the Li-DAR sensor and stereo camera for improved depth perception. Instead of directly fusing estimated depths acros…

Depth CompletionStereo-LiDAR FusionStereo MatchingStereo Matching Hand

PanoDepth: A Two-Stage Approach for Monocular Omnidirectional Depth Estimation

2022-02-02 · Yuyan Li, Zhixin Yan, Ye Duan, Liu Ren

Omnidirectional 3D information is essential for a wide range of applications such as Virtual Reality, Autonomous Driving, Robotics, etc. In this paper, we propose a novel, model-agnostic, two-stage pipeline for omnidirec…

Autonomous DrivingDepth EstimationMonocular Depth EstimationStereo Matching+1

End-to-End 3D Hand Pose Estimation from Stereo Cameras

2022-06-03 · Yuncheng Li, Zehao Xue, Yingying Wang, Liuhao Ge 외

This work proposes an end-to-end approach to estimate full 3D hand pose from stereo cameras. Most existing methods of estimating hand pose from stereo cameras apply stereo matching to obtain depth map and use depth-based…

3D Hand Pose EstimationHand Pose EstimationPose EstimationStereo Matching