Adjusting Bias in Long Range Stereo Matching: A semantics guided approach
Stereo vision generally involves the computation of pixel correspondences and estimation of disparities between rectified image pairs. In many applications, including simultaneous localization and mapping (SLAM) and 3D object detection, the disparities are primarily needed to calculate depth values and the accuracy of depth estimation is often more compelling than disparity estimation. The accuracy of disparity estimation, however, does not directly translate to the accuracy of depth estimation, especially for faraway objects. In the context of learning-based stereo systems, this is largely due to biases imposed by the choices of the disparity-based loss function and the training data. Consequently, the learning algorithms often produce unreliable depth estimates of foreground objects, particularly at large distances~($>50$m). To resolve this issue, we first analyze the effect of those biases and then propose a pair of novel depth-based loss functions for foreground and background, separately. These loss functions are tunable and can balance the inherent bias of the stereo learning algorithms. The efficacy of our solution is demonstrated by an extensive set of experiments, which are benchmarked against state of the art. We show on KITTI~2015 benchmark that our proposed solution yields substantial improvements in disparity and depth estimation, particularly for objects located at distances beyond 50 meters, outperforming the previous state of the art by $10\%$.
Code (0)
등록된 구현이 없습니다.
Tasks
3D Object DetectionAutonomous NavigationDepth EstimationDisparity Estimationobject-detectionObject DetectionSimultaneous Localization and MappingStereo MatchingSimilar Papers 제목 키워드 기반
URS-Stereo: Uncertainty-Guided Residual Search for Real-Time Stereo Matching
Real-time stereo matching is crucial for robotics, autonomous systems, and embedded vision applications, where both computational efficiency and disparity accuracy are required. Recent coarse-to-fine stereo matching meth…
Computational EfficiencyDisparity EstimationMaDis-Stereo: Enhanced Stereo Matching via Distilled Masked Image Modeling
In stereo matching, CNNs have traditionally served as the predominant architectures. Although Transformer-based stereo models have been studied recently, their performance still lags behind CNN-based stereo models due to…
Depth EstimationDepth PredictionImage ReconstructionInductive Bias+1Object-Centric Stereo Ranging for Autonomous Driving: From Dense Disparity to Census-Based Template Matching
Accurate depth estimation is critical for autonomous driving perception systems, particularly for long range vehicle detection on highways. Traditional dense stereo matching methods such as Block Matching (BM) and Semi G…
Autonomous DrivingDepth EstimationA novel stereo matching pipeline with robustness and unfixed disparity search range
Stereo matching is an essential basis for various applications, but most stereo matching methods have poor generalization performance and require a fixed disparity search range. Moreover, current stereo matching methods …
Stereo MatchingPPMStereo: Pick-and-Play Memory Construction for Consistent Dynamic Stereo Matching
Temporally consistent depth estimation from stereo video is critical for real-world applications such as augmented reality, where inconsistent depth estimation disrupts the immersion of users. Despite its importance, thi…
Depth Estimation