Image-based localization using LSTMs for structured feature correlation
In this work we propose a new CNN+LSTM architecture for camera pose regression for indoor and outdoor scenes. CNNs allow us to learn suitable feature representations for localization that are robust against motion blur and illumination changes. We make use of LSTM units on the CNN output, which play the role of a structured dimensionality reduction on the feature vector, leading to drastic improvements in localization performance. We provide extensive quantitative comparison of CNN-based and SIFT-based localization methods, showing the weaknesses and strengths of each. Furthermore, we present a new large-scale indoor dataset with accurate ground truth from a laser scanner. Experimental results on both indoor and outdoor public datasets show our method outperforms existing deep architectures, and can localize images in hard conditions, e.g., in the presence of mostly textureless surfaces, where classic SIFT-based methods fail.
Code (0)
등록된 구현이 없습니다.
Tasks
Dimensionality ReductionFeature CorrelationImage-Based LocalizationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Cross-view and Cross-domain Underwater Localization based on Optical Aerial and Acoustic Underwater Images
Cross-view image matches have been widely explored on terrestrial image localization using aerial images from drones or satellites. This study expands the cross-view image match idea and proposes a cross-domain and cross…
Deep Canonically Correlated LSTMs
We examine Deep Canonically Correlated LSTMs as a way to learn nonlinear transformations of variable length sequences and embed them into a correlated, fixed dimensional space. We use LSTMs to transform multi-view time-s…
Time SeriesTime Series AnalysisPotential quality improvement of stochastic optical localization nanoscopy images obtained by frame by frame localization algorithms
A data movie of stochastic optical localization nanoscopy contains spatial and temporal correlations, both providing information of emitter locations. The majority of localization algorithms in the literature estimate em…
Contextual and Seasonal LSTMs for Time Series Anomaly Detection
Univariate time series (UTS), where each timestamp records a single variable, serve as crucial indicators in web systems and cloud servers. Anomaly detection in UTS plays an essential role in both data mining and system …
Time Series Anomaly DetectionGraph-Structured Representations for Visual Question Answering
This paper proposes to improve visual question answering (VQA) with structured representations of both scene contents and questions. A key challenge in VQA is to require joint reasoning over the visual and text domains. …
Multiple-choiceQuestion AnsweringVisual Question AnsweringVisual Question Answering (VQA)