EgoNN: Egocentric Neural Network for Point Cloud Based 6DoF Relocalization at the City Scale
The paper presents a deep neural network-based method for global and local descriptors extraction from a point cloud acquired by a rotating 3D LiDAR. The descriptors can be used for two-stage 6DoF relocalization. First, a course position is retrieved by finding candidates with the closest global descriptor in the database of geo-tagged point clouds. Then, the 6DoF pose between a query point cloud and a database point cloud is estimated by matching local descriptors and using a robust estimator such as RANSAC. Our method has a simple, fully convolutional architecture based on a sparse voxelized representation. It can efficiently extract a global descriptor and a set of keypoints with local descriptors from large point clouds with tens of thousand points. Our code and pretrained models are publicly available on the project website.
Code (1)
Tasks
PositionSimilar Papers 제목 키워드 기반
DSC: Deep Scan Context Descriptor for Large-Scale Place Recognition
LiDAR-based place recognition is an essential and challenging task both in loop closure detection and global relocalization. We propose Deep Scan Context (DSC), a general and discriminative global descriptor that capture…
Graph Neural NetworkLoop Closure DetectionLegoNN: Building Modular Encoder-Decoder Models
State-of-the-art encoder-decoder models (e.g. for machine translation (MT) or automatic speech recognition (ASR)) are constructed and trained end-to-end as an atomic unit. No component of the model can be (re-)used witho…
Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Decoderde-en+4Hybrid Structure-from-Motion and Camera Relocalization for Enhanced Egocentric Localization
We built our pipeline EgoLoc-v1, mainly inspired by EgoLoc. We propose a model ensemble strategy to improve the camera pose estimation part of the VQ3D task, which has been proven to be essential in previous work. The co…
Camera Pose EstimationCamera RelocalizationPose EstimationDH3D: Deep Hierarchical 3D Descriptors for Robust Large-Scale 6DoF Relocalization
For relocalization in large-scale point clouds, we propose the first approach that unifies global place recognition and local 6DoF pose refinement. To this end, we design a Siamese network that jointly learns 3D local fe…
3D Place RecognitionPoint Cloud RegistrationPoint Cloud RetrievalRetrievalOffline-Online Hierarchical 3D Global Relocalization With Synthetic LiDAR Sensing and Descriptor-Space Retrieval
3D global relocalization is one of the key capabilities for mobile robots in practical applications. However, in large scale spaces, existing methods often suffer from prolonged online relocalization time due to factors …
Point Cloud RegistrationComputational Efficiency