Geometry-based Occlusion-Aware Unsupervised Stereo Matching for Autonomous Driving
Recently, there are emerging many stereo matching methods for autonomous driving based on unsupervised learning. Most of them take advantage of reconstruction losses to remove dependency on disparity groundtruth. Occlusion handling is a challenging problem in stereo matching, especially for unsupervised methods. Previous unsupervised methods failed to take full advantage of geometry properties in occlusion handling. In this paper, we introduce an effective way to detect occlusion regions and propose a novel unsupervised training strategy to deal with occlusion that only uses the predicted left disparity map, by making use of its geometry features in an iterative way. In the training process, we regard the predicted left disparity map as pseudo groundtruth and infer occluded regions using geometry features. The resulting occlusion mask is then used in either training, post-processing, or both of them as guidance. Experiments show that our method could deal with the occlusion problem effectively and significantly outperforms the other unsupervised methods for stereo matching. Moreover, our occlusion-aware strategies can be extended to the other stereo methods conveniently and improve their performances.
Code (0)
등록된 구현이 없습니다.
Tasks
Autonomous DrivingOcclusion HandlingStereo MatchingSimilar Papers 제목 키워드 기반
Co-Teaching: An Ark to Unsupervised Stereo Matching
Stereo matching is a key component of autonomous driving perception. Recent unsupervised stereo matching approaches have received adequate attention due to their advantage of not requiring disparity ground truth. These a…
Autonomous DrivingStereo MatchingLevel Set Binocular Stereo with Occlusions
Localizing stereo boundaries and predicting nearby disparities are difficult because stereo boundaries induce occluded regions where matching cues are absent. Most modern computer vision algorithms treat occlusions secon…
Occlusion HandlingHOT-POT: Optimal Transport for Sparse Stereo Matching
Stereo vision between images faces a range of challenges, including occlusions, motion, and camera distortions, across applications in autonomous driving, robotics, and face analysis. Due to parameter sensitivity, furthe…
Autonomous DrivingLevel Set Stereo for Cooperative Grouping with Occlusion
Localizing stereo boundaries is difficult because matching cues are absent in the occluded regions that are adjacent to them. We introduce an energy and level-set optimizer that improves boundaries by encoding the essent…
Occlusion HandlingNoise-Aware Unsupervised Deep Lidar-Stereo Fusion
In this paper, we present LidarStereoNet, the first unsupervised Lidar-stereo fusion network, which can be trained in an end-to-end manner without the need of ground truth depth maps. By introducing a novel "Feedback Loo…
3D geometryDepth CompletionStereo MatchingStereo Matching Hand