Augmenting Visual Place Recognition with Structural Cues
In this paper, we propose to augment image-based place recognition with structural cues. Specifically, these structural cues are obtained using structure-from-motion, such that no additional sensors are needed for place recognition. This is achieved by augmenting the 2D convolutional neural network (CNN) typically used for image-based place recognition with a 3D CNN that takes as input a voxel grid derived from the structure-from-motion point cloud. We evaluate different methods for fusing the 2D and 3D features and obtain best performance with global average pooling and simple concatenation. On the Oxford RobotCar dataset, the resulting descriptor exhibits superior recognition performance compared to descriptors extracted from only one of the input modalities, including state-of-the-art image-based descriptors. Especially at low descriptor dimensionalities, we outperform state-of-the-art descriptors by up to 90%.
Code (0)
등록된 구현이 없습니다.
Tasks
Visual Place RecognitionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Adding Cues to Binary Feature Descriptors for Visual Place Recognition
In this paper we propose an approach to embed continuous and selector cues in binary feature descriptors used for visual place recognition. The embedding is achieved by extending each feature descriptor with a binary str…
Image RetrievalRetrievalVisual Place RecognitionVisual Place Recognition in Forests with Depth-Aware Distillation
Visual place recognition in natural forest environments remains challenging due to repetitive vegetation, weak structural cues, and significant appearance variation across traversals. To address this limitation, this pap…
Visual Place RecognitionBEV$^2$PR: BEV-Enhanced Visual Place Recognition with Structural Cues
In this paper, we propose a new image-based visual place recognition (VPR) framework by exploiting the structural cues in bird's-eye view (BEV) from a single monocular camera. The motivation arises from two key observati…
Visual Place RecognitionA Fast and Robust Place Recognition Approach for Stereo Visual Odometry Using LiDAR Descriptors
Place recognition is a core component of Simultaneous Localization and Mapping (SLAM) algorithms. Particularly in visual SLAM systems, previously-visited places are recognized by measuring the appearance similarity betwe…
Computational EfficiencySimultaneous Localization and MappingVisual OdometryMMS-VPR: Multimodal Street-Level Visual Place Recognition Dataset and Benchmark
Existing visual place recognition (VPR) datasets predominantly rely on vehicle-mounted imagery, lack multimodal diversity and underrepresent dense, mixed-use street-level spaces, especially in non-Western urban contexts.…
Multimodal ReasoningVisual Place Recognition