paper-with-me

Papers

Monocular Camera Localization in Prior LiDAR Maps with 2D-3D Line Correspondences

2020-04-01 · Huai Yu, Weikun Zhen, Wen Yang, Ji Zhang, Sebastian Scherer

Light-weight camera localization in existing maps is essential for vision-based navigation. Currently, visual and visual-inertial odometry (VO\&VIO) techniques are well-developed for state estimation but with inevitable accumulated drifts and pose jumps upon loop closure. To overcome these problems, we propose an efficient monocular camera localization method in prior LiDAR maps using direct 2D-3D line correspondences. To handle the appearance differences and modality gaps between LiDAR point clouds and images, geometric 3D lines are extracted offline from LiDAR maps while robust 2D lines are extracted online from video sequences. With the pose prediction from VIO, we can efficiently obtain coarse 2D-3D line correspondences. Then the camera poses and 2D-3D correspondences are iteratively optimized by minimizing the projection error of correspondences and rejecting outliers. Experimental results on the EurocMav dataset and our collected dataset demonstrate that the proposed method can efficiently estimate camera poses without accumulated drifts or pose jumps in structured environments.

📄 PDF Abstract BibTeX arXiv:2004.00740

Code (1)

levenberg/2D-3D-pose-tracking 공식 구현 pytorch

Tasks

Camera LocalizationPose PredictionPose TrackingState Estimation

Similar Papers 제목 키워드 기반

CMRNext: Camera to LiDAR Matching in the Wild for Localization and Extrinsic Calibration

2024-01-31 · Daniele Cattaneo, Abhinav Valada

LiDARs are widely used for mapping and localization in dynamic environments. However, their high cost limits their widespread adoption. On the other hand, monocular localization in LiDAR maps using inexpensive cameras is…

Optical Flow EstimationPose Estimation

Semantic Image Alignment for Vehicle Localization

2021-10-08 · Markus Herb, Matthias Lemberger, Marcel M. Schmitt, Alexander Kurz 외

Accurate and reliable localization is a fundamental requirement for autonomous vehicles to use map information in higher-level tasks such as navigation or planning. In this paper, we present a novel approach to vehicle l…

Autonomous VehiclesSemantic SegmentationVisual Localization

Monocular Camera Localization for Automated Vehicles Using Image Retrieval

2021-09-13 · Eunhyek Joa, Yibo Sun, Francesco Borrelli

We address the problem of finding the current position and heading angle of an autonomous vehicle in real-time using a single camera. Compared to methods which require LiDARs and high definition (HD) 3D maps in real-time…

Camera LocalizationImage RetrievalRetrieval

CMRNet++: Map and Camera Agnostic Monocular Visual Localization in LiDAR Maps

2020-04-20 · Daniele Cattaneo, Domenico Giorgio Sorrenti, Abhinav Valada

Localization is a critically essential and crucial enabler of autonomous robots. While deep learning has made significant strides in many computer vision tasks, it is still yet to make a sizeable impact on improving capa…

Autonomous DrivingDeep LearningVisual Localization

Pole-based Vehicle Localization with Vector Maps: A Camera-LiDAR Comparative Study

2024-12-11 · Maxime Noizet, Philippe Xu, Philippe Bonnifait

For autonomous navigation, accurate localization with respect to a map is needed. In urban environments, infrastructure such as buildings or bridges cause major difficulties to Global Navigation Satellite Systems (GNSS) …

Autonomous Navigation