Sparse LiDAR Assisted Self-supervised Stereo Disparity Estimation
Deep stereo matching has made significant progress in recent years. However, state-of-the-art methods are based on expensive 4D cost volume, which limits their use in real-world applications. To address this issue, 3D correlation maps and iterative disparity updates have been proposed. Regarding that in real-world platforms, such as self-driving cars and robots, the Lidar is usually installed. Thus we further introduce the sparse Lidar point into the iterative updates, which alleviates the burden of network updating the disparity from zero states. Furthermore, we propose training the network in a self-supervised way so that it can be trained on any captured data for better generalization ability. Experiments and comparisons show that the presented method is effective and achieves comparable results with related methods.
Code (0)
등록된 구현이 없습니다.
Tasks
Disparity EstimationSelf-Driving CarsStereo Disparity EstimationStereo MatchingSimilar Papers 제목 키워드 기반
LiStereo: Generate Dense Depth Maps from LIDAR and Stereo Imagery
An accurate depth map of the environment is critical to the safe operation of autonomous robots and vehicles. Currently, either light detection and ranging (LIDAR) or stereo matching algorithms are used to acquire such d…
Stereo-LiDAR FusionStereo MatchingStereo Matching HandLeveraging Sparse LiDAR for RAFT-Stereo: A Depth Pre-Fill Perspective
We investigate LiDAR guidance within the RAFT-Stereo framework, aiming to improve stereo matching accuracy by injecting precise LiDAR depth into the initial disparity map. We find that the effectiveness of LiDAR guidance…
KDD-LOAM: Jointly Learned Keypoint Detector and Descriptors Assisted LiDAR Odometry and Mapping
Sparse keypoint matching based on distinct 3D feature representations can improve the efficiency and robustness of point cloud registration. Existing learning-based 3D descriptors and keypoint detectors are either indepe…
Point Cloud RegistrationSelf-Supervised LearningDurLAR: A High-fidelity 128-channel LiDAR Dataset with Panoramic Ambient and Reflectivity Imagery for Multi-modal Autonomous Driving Applications
We present DurLAR, a high-fidelity 128-channel 3D LiDAR dataset with panoramic ambient (near infrared) and reflectivity imagery, as well as a sample benchmark task using depth estimation for autonomous driving applicatio…
Autonomous DrivingDepth EstimationMonocular Depth EstimationAdvancing Self-supervised Monocular Depth Learning with Sparse LiDAR
Self-supervised monocular depth prediction provides a cost-effective solution to obtain the 3D location of each pixel. However, the existing approaches usually lead to unsatisfactory accuracy, which is critical for auton…
3D Object DetectionDepth CompletionDepth EstimationDepth Prediction+4