Learning Sequential Descriptors for Sequence-based Visual Place Recognition
In robotics, Visual Place Recognition is a continuous process that receives as input a video stream to produce a hypothesis of the robot's current position within a map of known places. This task requires robust, scalable, and efficient techniques for real applications. This work proposes a detailed taxonomy of techniques using sequential descriptors, highlighting different mechanism to fuse the information from the individual images. This categorization is supported by a complete benchmark of experimental results that provides evidence on the strengths and weaknesses of these different architectural choices. In comparison to existing sequential descriptors methods, we further investigate the viability of Transformers instead of CNN backbones, and we propose a new ad-hoc sequence-level aggregator called SeqVLAD, which outperforms prior state of the art on different datasets. The code is available at https://github.com/vandal-vpr/vg-transformers.
Code (1)
Tasks
PositionVisual Place RecognitionSimilar Papers 제목 키워드 기반
SeqNet: Learning Descriptors for Sequence-based Hierarchical Place Recognition
Visual Place Recognition (VPR) is the task of matching current visual imagery from a camera to images stored in a reference map of the environment. While initial VPR systems used simple direct image methods or hand-craft…
Autonomous DrivingImage RetrievalRepresentation LearningSequential Place Learning+4Learning Sequence Descriptor based on Spatio-Temporal Attention for Visual Place Recognition
Visual Place Recognition (VPR) aims to retrieve frames from a geotagged database that are located at the same place as the query frame. To improve the robustness of VPR in perceptually aliasing scenarios, sequence-based …
RetrievalVisual Place RecognitionDelta Descriptors: Change-Based Place Representation for Robust Visual Localization
Visual place recognition is challenging because there are so many factors that can cause the appearance of a place to change, from day-night cycles to seasonal change to atmospheric conditions. In recent years a large ra…
Autonomous DrivingImage RetrievalSequential Place RecognitionVideo Retrieval+2JIST: Joint Image and Sequence Training for Sequential Visual Place Recognition
Visual Place Recognition aims at recognizing previously visited places by relying on visual clues, and it is used in robotics applications for SLAM and localization. Since typically a mobile robot has access to a continu…
Multi-Task LearningVisual Place RecognitionVDNA-PR: Using General Dataset Representations for Robust Sequential Visual Place Recognition
This paper adapts a general dataset representation technique to produce robust Visual Place Recognition (VPR) descriptors, crucial to enable real-world mobile robot localisation. Two parallel lines of work on VPR have sh…
Visual Place Recognition