Deep Learning Features at Scale for Visual Place Recognition
The success of deep learning techniques in the computer vision domain has triggered a range of initial investigations into their utility for visual place recognition, all using generic features from networks that were trained for other types of recognition tasks. In this paper, we train, at large scale, two CNN architectures for the specific place recognition task and employ a multi-scale feature encoding method to generate condition- and viewpoint-invariant features. To enable this training to occur, we have developed a massive Specific PlacEs Dataset (SPED) with hundreds of examples of place appearance change at thousands of different places, as opposed to the semantic place type datasets currently available. This new dataset enables us to set up a training regime that interprets place recognition as a classification problem. We comprehensively evaluate our trained networks on several challenging benchmark place recognition datasets and demonstrate that they achieve an average 10% increase in performance over other place recognition algorithms and pre-trained CNNs. By analyzing the network responses and their differences from pre-trained networks, we provide insights into what a network learns when training for place recognition, and what these results signify for future research in this area.
Code (0)
등록된 구현이 없습니다.
Tasks
Deep LearningVisual Place RecognitionSimilar Papers 제목 키워드 기반
City-Scale Visual Place Recognition with Deep Local Features Based on Multi-Scale Ordered VLAD Pooling
Visual place recognition is the task of recognizing a place depicted in an image based on its pure visual appearance without metadata. In visual place recognition, the challenges lie upon not only the changes in lighting…
Content-Based Image RetrievalImage RetrievalRetrievalVisual Place RecognitionMeshVPR: Citywide Visual Place Recognition Using 3D Meshes
Mesh-based scene representation offers a promising direction for simplifying large-scale hierarchical visual localization pipelines, combining a visual place recognition step based on global features (retrieval) and a vi…
RetrievalVisual LocalizationVisual Place RecognitionPatch-NetVLAD: Multi-Scale Fusion of Locally-Global Descriptors for Place Recognition
Visual Place Recognition is a challenging task for robotics and autonomous systems, which must deal with the twin problems of appearance and viewpoint change in an always changing world. This paper introduces Patch-NetVL…
Computational EfficiencyVisual LocalizationVisual Place RecognitionA Fast and Robust Place Recognition Approach for Stereo Visual Odometry Using LiDAR Descriptors
Place recognition is a core component of Simultaneous Localization and Mapping (SLAM) algorithms. Particularly in visual SLAM systems, previously-visited places are recognized by measuring the appearance similarity betwe…
Computational EfficiencySimultaneous Localization and MappingVisual OdometryEnd-to-End Visual Speech Recognition for Small-Scale Datasets
Visual speech recognition models traditionally consist of two stages, feature extraction and classification. Several deep learning approaches have been recently presented aiming to replace the feature extraction stage by…
General Classificationspeech-recognitionSpeech RecognitionVisual Speech Recognition