3D3L: Deep Learned 3D Keypoint Detection and Description for LiDARs
With the advent of powerful, light-weight 3D LiDARs, they have become the hearth of many navigation and SLAM algorithms on various autonomous systems. Pointcloud registration methods working with unstructured pointclouds such as ICP are often computationally expensive or require a good initial guess. Furthermore, 3D feature-based registration methods have never quite reached the robustness of 2D methods in visual SLAM. With the continuously increasing resolution of LiDAR range images, these 2D methods not only become applicable but should exploit the illumination-independent modalities that come with it, such as depth and intensity. In visual SLAM, deep learned 2D features and descriptors perform exceptionally well compared to traditional methods. In this publication, we use a state-of-the-art 2D feature network as a basis for 3D3L, exploiting both intensity and depth of LiDAR range images to extract powerful 3D features. Our results show that these keypoints and descriptors extracted from LiDAR scan images outperform state-of-the-art on different benchmark metrics and allow for robust scan-to-scan alignment as well as global localization.
Code (1)
Tasks
Keypoint DetectionSimilar Papers 제목 키워드 기반
R2D2: Reliable and Repeatable Detector and Descriptor
Interest point detection and local feature description are fundamental steps in many computer vision applications. Classical approaches are based on a detect-then-describe paradigm where separate handcrafted methods are …
Atari GamesCamera LocalizationImage MatchingInterest Point Detection+2R2D2: Repeatable and Reliable Detector and Descriptor
Interest point detection and local feature description are fundamental steps in many computer vision applications. Classical methods for these tasks are based on a detect-then-describe paradigm where separate handcrafted…
Interest Point DetectionKeypoint DetectionMetric LearningNeural Outlier Rejection for Self-Supervised Keypoint Learning
Identifying salient points in images is a crucial component for visual odometry, Structure-from-Motion or SLAM algorithms. Recently, several learned keypoint methods have demonstrated compelling performance on challengin…
Homography EstimationInterest Point DetectionKeypoint DetectionVisual OdometryRIPE: Reinforcement Learning on Unlabeled Image Pairs for Robust Keypoint Extraction
We introduce RIPE, an innovative reinforcement learning-based framework for weakly-supervised training of a keypoint extractor that excels in both detection and description tasks. In contrast to conventional training reg…
MASS: Multi-Attentional Semantic Segmentation of LiDAR Data for Dense Top-View Understanding
At the heart of all automated driving systems is the ability to sense the surroundings, e.g., through semantic segmentation of LiDAR sequences, which experienced a remarkable progress due to the release of large datasets…
3D Object DetectionGraph Attentionobject-detectionObject Detection+3