Robust Monocular Localization in Sparse HD Maps Leveraging Multi-Task Uncertainty Estimation
Robust localization in dense urban scenarios using a low-cost sensor setup and sparse HD maps is highly relevant for the current advances in autonomous driving, but remains a challenging topic in research. We present a novel monocular localization approach based on a sliding-window pose graph that leverages predicted uncertainties for increased precision and robustness against challenging scenarios and per frame failures. To this end, we propose an efficient multi-task uncertainty-aware perception module, which covers semantic segmentation, as well as bounding box detection, to enable the localization of vehicles in sparse maps, containing only lane borders and traffic lights. Further, we design differentiable cost maps that are directly generated from the estimated uncertainties. This opens up the possibility to minimize the reprojection loss of amorphous map elements in an association free and uncertainty-aware manner. Extensive evaluation on the Lyft 5 dataset shows that, despite the sparsity of the map, our approach enables robust and accurate 6D localization in challenging urban scenarios
Code (0)
등록된 구현이 없습니다.
Tasks
Autonomous DrivingSemantic SegmentationSimilar Papers 제목 키워드 기반
3D Densification for Multi-Map Monocular VSLAM in Endoscopy
Multi-map Sparse Monocular visual Simultaneous Localization and Mapping applied to monocular endoscopic sequences has proven efficient to robustly recover tracking after the frequent losses in endoscopy due to motion blu…
Camera LocalizationDepth EstimationMonocular Depth EstimationSimultaneous Localization and MappingMarginalized Bundle Adjustment: Multi-View Camera Pose from Monocular Depth Estimates
Structure-from-Motion (SfM) is a fundamental 3D vision task for recovering camera parameters and scene geometry from multi-view images. While recent deep learning advances enable accurate Monocular Depth Estimation (MDE)…
Monocular Depth EstimationPoint CloudsMGS-SLAM: Monocular Sparse Tracking and Gaussian Mapping with Depth Smooth Regularization
This letter introduces a novel framework for dense Visual Simultaneous Localization and Mapping (VSLAM) based on Gaussian Splatting. Recently, SLAM based on Gaussian Splatting has shown promising results. However, in mon…
Depth EstimationNovel View SynthesisPose EstimationSimultaneous Localization and Mapping+1Monocular Direct Sparse Localization in a Prior 3D Surfel Map
In this paper, we introduce an approach to tracking the pose of a monocular camera in a prior surfel map. By rendering vertex and normal maps from the prior surfel map, the global planar information for the sparse tracke…
Camera LocalizationAdvancing Self-supervised Monocular Depth Learning with Sparse LiDAR
Self-supervised monocular depth prediction provides a cost-effective solution to obtain the 3D location of each pixel. However, the existing approaches usually lead to unsatisfactory accuracy, which is critical for auton…
3D Object DetectionDepth CompletionDepth EstimationDepth Prediction+4