On the Performance of ConvNet Features for Place Recognition
After the incredible success of deep learning in the computer vision domain, there has been much interest in applying Convolutional Network (ConvNet) features in robotic fields such as visual navigation and SLAM. Unfortunately, there are fundamental differences and challenges involved. Computer vision datasets are very different in character to robotic camera data, real-time performance is essential, and performance priorities can be different. This paper comprehensively evaluates and compares the utility of three state-of-the-art ConvNets on the problems of particular relevance to navigation for robots; viewpoint-invariance and condition-invariance, and for the first time enables real-time place recognition performance using ConvNets with large maps by integrating a variety of existing (locality-sensitive hashing) and novel (semantic search space partitioning) optimization techniques. We present extensive experiments on four real world datasets cultivated to evaluate each of the specific challenges in place recognition. The results demonstrate that speed-ups of two orders of magnitude can be achieved with minimal accuracy degradation, enabling real-time performance. We confirm that networks trained for semantic place categorization also perform better at (specific) place recognition when faced with severe appearance changes and provide a reference for which networks and layers are optimal for different aspects of the place recognition problem.
Code (1)
Tasks
Visual NavigationSimilar Papers 제목 키워드 기반
Robust ConvNet Landmark-Based Visual Place Recognition by Optimizing Landmark Matching
Visual place recognition (VPR) is a fundamental but challenging problem that has not been solved completely for a long time, especially in a kaleidoscopic environment. Recent advanced works which exploit ConvNet landma…
Visual Place RecognitionSpatio-Semantic ConvNet-Based Visual Place Recognition
We present a Visual Place Recognition system that follows the two-stage format common to image retrieval pipelines. The system encodes images of places by employing the activations of different layers of a pre-trained, o…
Image RetrievalRetrievalVisual Place RecognitionLarge-scale Continuous Gesture Recognition Using Convolutional Neural Networks
This paper addresses the problem of continuous gesture recognition from sequences of depth maps using convolutional neutral networks (ConvNets). The proposed method first segments individual gestures from a depth sequenc…
General ClassificationGesture RecognitionGoogle Landmark Retrieval 2021 Competition Third Place Solution
We present our solutions to the Google Landmark Challenges 2021, for both the retrieval and the recognition tracks. Both solutions are ensembles of transformers and ConvNet models based on Sub-center ArcFace with dynamic…
RetrievalSparsifying Neural Network Connections for Face Recognition
This paper proposes to learn high-performance deep ConvNets with sparse neural connections, referred to as sparse ConvNets, for face recognition. The sparse ConvNets are learned in an iterative way, each time one additio…
Face Recognition