Monocular Camera Localization in Prior LiDAR Maps with 2D-3D Line Correspondences
Light-weight camera localization in existing maps is essential for vision-based navigation. Currently, visual and visual-inertial odometry (VO\&VIO) techniques are well-developed for state estimation but with inevitable accumulated drifts and pose jumps upon loop closure. To overcome these problems, we propose an efficient monocular camera localization method in prior LiDAR maps using direct 2D-3D line correspondences. To handle the appearance differences and modality gaps between LiDAR point clouds and images, geometric 3D lines are extracted offline from LiDAR maps while robust 2D lines are extracted online from video sequences. With the pose prediction from VIO, we can efficiently obtain coarse 2D-3D line correspondences. Then the camera poses and 2D-3D correspondences are iteratively optimized by minimizing the projection error of correspondences and rejecting outliers. Experimental results on the EurocMav dataset and our collected dataset demonstrate that the proposed method can efficiently estimate camera poses without accumulated drifts or pose jumps in structured environments.
Code (1)
Tasks
Camera LocalizationPose PredictionPose TrackingState EstimationSimilar Papers 제목 키워드 기반
CMRNext: Camera to LiDAR Matching in the Wild for Localization and Extrinsic Calibration
LiDARs are widely used for mapping and localization in dynamic environments. However, their high cost limits their widespread adoption. On the other hand, monocular localization in LiDAR maps using inexpensive cameras is…
Optical Flow EstimationPose EstimationSemantic Image Alignment for Vehicle Localization
Accurate and reliable localization is a fundamental requirement for autonomous vehicles to use map information in higher-level tasks such as navigation or planning. In this paper, we present a novel approach to vehicle l…
Autonomous VehiclesSemantic SegmentationVisual LocalizationMonocular Camera Localization for Automated Vehicles Using Image Retrieval
We address the problem of finding the current position and heading angle of an autonomous vehicle in real-time using a single camera. Compared to methods which require LiDARs and high definition (HD) 3D maps in real-time…
Camera LocalizationImage RetrievalRetrievalCMRNet++: Map and Camera Agnostic Monocular Visual Localization in LiDAR Maps
Localization is a critically essential and crucial enabler of autonomous robots. While deep learning has made significant strides in many computer vision tasks, it is still yet to make a sizeable impact on improving capa…
Autonomous DrivingDeep LearningVisual LocalizationPole-based Vehicle Localization with Vector Maps: A Camera-LiDAR Comparative Study
For autonomous navigation, accurate localization with respect to a map is needed. In urban environments, infrastructure such as buildings or bridges cause major difficulties to Global Navigation Satellite Systems (GNSS) …
Autonomous Navigation