Efficient 3D Point Cloud Feature Learning for Large-Scale Place Recognition
Point cloud based retrieval for place recognition is still a challenging problem due to drastic appearance and illumination changes of scenes in changing environments. Existing deep learning based global descriptors for the retrieval task usually consume a large amount of computation resources (e.g., memory), which may not be suitable for the cases of limited hardware resources. In this paper, we develop an efficient point cloud learning network (EPC-Net) to form a global descriptor for visual place recognition, which can obtain good performance and reduce computation memory and inference time. First, we propose a lightweight but effective neural network module, called ProxyConv, to aggregate the local geometric features of point clouds. We leverage the spatial adjacent matrix and proxy points to simplify the original edge convolution for lower memory consumption. Then, we design a lightweight grouped VLAD network (G-VLAD) to form global descriptors for retrieval. Compared with the original VLAD network, we propose a grouped fully connected (GFC) layer to decompose the high-dimensional vectors into a group of low-dimensional vectors, which can reduce the number of parameters of the network and maintain the discrimination of the feature vector. Finally, to further reduce the inference time, we develop a simple version of EPC-Net, called EPC-Net-L, which consists of two ProxyConv modules and one max pooling layer to aggregate global descriptors. By distilling the knowledge from EPC-Net, EPC-Net-L can obtain discriminative global descriptors for retrieval. Extensive experiments on the Oxford dataset and three in-house datasets demonstrate that our proposed method can achieve state-of-the-art performance with lower parameters, FLOPs, and runtime per frame.
Code (1)
Tasks
Point Cloud RetrievalRetrievalVisual Place RecognitionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
LPD-Net: 3D Point Cloud Learning for Large-Scale Place Recognition and Environment Analysis
Point cloud based place recognition is still an open issue due to the difficulty in extracting local features from the raw 3D point cloud and generating the global descriptor, and it's even harder in the large-scale dyna…
3D Place RecognitionPoint Cloud RetrievalRetrievalVisual Place RecognitionPyramid Point Cloud Transformer for Large-Scale Place Recognition
Recently, deep learning based point cloud descriptors have achieved impressive results in the place recognition task. Nonetheless, due to the sparsity of point clouds, how to extract discriminative local features of …
3D Place RecognitionPoint Cloud RetrievalRetrievalRPR-Net: A Point Cloud-based Rotation-aware Large Scale Place Recognition Network
Point cloud-based large scale place recognition is an important but challenging task for many applications such as Simultaneous Localization and Mapping (SLAM). Taking the task as a point cloud retrieval problem, previou…
Autonomous DrivingPoint Cloud RetrievalRetrievalSimultaneous Localization and MappingPointNetVLAD: Deep Point Cloud Based Retrieval for Large-Scale Place Recognition
Unlike its image based counterpart, point cloud based retrieval for place recognition has remained as an unexplored and unsolved problem. This is largely due to the difficulty in extracting local feature descriptors from…
3D Place RecognitionPoint Cloud RetrievalRetrievalTriplet+2A Registration-aided Domain Adaptation Network for 3D Point Cloud Based Place Recognition
In the field of large-scale SLAM for autonomous driving and mobile robotics, 3D point cloud based place recognition has aroused significant research interest due to its robustness to changing environments with drastic da…
3D Place RecognitionAutonomous DrivingDomain AdaptationMetric Learning