Learning Semantics for Visual Place Recognition through Multi-Scale Attention
In this paper we address the task of visual place recognition (VPR), where the goal is to retrieve the correct GPS coordinates of a given query image against a huge geotagged gallery. While recent works have shown that building descriptors incorporating semantic and appearance information is beneficial, current state-of-the-art methods opt for a top down definition of the significant semantic content. Here we present the first VPR algorithm that learns robust global embeddings from both visual appearance and semantic content of the data, with the segmentation process being dynamically guided by the recognition of places through a multi-scale attention module. Experiments on various scenarios validate this new approach and demonstrate its performance against state-of-the-art methods. Finally, we propose the first synthetic-world dataset suited for both place recognition and segmentation tasks.
Code (1)
Tasks
SegmentationVisual Place RecognitionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
MSSPlace: Multi-Sensor Place Recognition with Visual and Text Semantics
Place recognition is a challenging task in computer vision, crucial for enabling autonomous vehicles and robots to navigate previously visited environments. While significant progress has been made in learnable multimoda…
Autonomous VehiclesNavigateSemantic SegmentationSemantic-Enhanced Cross-Modal Place Recognition for Robust Robot Localization
Ensuring accurate localization of robots in environments without GPS capability is a challenging task. Visual Place Recognition (VPR) techniques can potentially achieve this goal, but existing RGB-based methods are sensi…
Visual Place RecognitionContrastive LearningGeometric MatchingTextPlace: Visual Place Recognition and Topological Localization Through Reading Scene Texts
Visual place recognition is a fundamental problem for many vision based applications. Sparse feature and deep learning based methods have been successful and dominant over the decade. However, most of them do not explici…
Visual Place RecognitionCity-Scale Visual Place Recognition with Deep Local Features Based on Multi-Scale Ordered VLAD Pooling
Visual place recognition is the task of recognizing a place depicted in an image based on its pure visual appearance without metadata. In visual place recognition, the challenges lie upon not only the changes in lighting…
Content-Based Image RetrievalImage RetrievalRetrievalVisual Place RecognitionA Fast and Robust Place Recognition Approach for Stereo Visual Odometry Using LiDAR Descriptors
Place recognition is a core component of Simultaneous Localization and Mapping (SLAM) algorithms. Particularly in visual SLAM systems, previously-visited places are recognized by measuring the appearance similarity betwe…
Computational EfficiencySimultaneous Localization and MappingVisual Odometry