Are Large-Scale 3D Models Really Necessary for Accurate Visual Localization?
Accurate visual localization is a key technology for autonomous navigation. 3D structure-based methods employ 3D models of the scene to estimate the full 6DOF pose of a camera very accurately. However, constructing (and extending) large-scale 3D models is still a significant challenge. In contrast, 2D image retrieval-based methods only require a database of geo-tagged images, which is trivial to construct and to maintain. They are often considered inaccurate since they only approximate the positions of the cameras. Yet, the exact camera pose can theoretically be recovered when enough relevant database images are retrieved. In this paper, we demonstrate experimentally that large-scale 3D models are not strictly necessary for accurate visual localization. We create reference poses for a large and challenging urban dataset. Using these poses, we show that combining image-based methods with local reconstructions results in a pose accuracy similar to the state-of-the-art structure-based methods. Our results suggest that we might want to reconsider the current approach for accurate large-scale localization.
Code (0)
등록된 구현이 없습니다.
Tasks
Autonomous NavigationImage RetrievalRetrievalVisual LocalizationSimilar Papers 제목 키워드 기반
A scalar per patch from pre-trained ViTs enables fast moving navigation in the real world
Trained policies for real-world robotics rely on computer vision components, typically in the form of pre-trained visual encoders. These encoders are an essential component and it has been shown that their power does not…
A shallow residual neural network to predict the visual cortex response
Understanding how the visual cortex of the human brain really works is still an open problem for science today. A better understanding of natural intelligence could also benefit object-recognition algorithms based on con…
Object RecognitionWhat Really is Deep Learning Doing?
Deep learning has achieved a great success in many areas, from computer vision to natural language processing, to game playing, and much more. Yet, what deep learning is really doing is still an open question. There are …
Deep LearningOpen-Ended Question AnsweringAccurate and Real-time Pseudo Lidar Detection: Is Stereo Neural Network Really Necessary?
The proposal of Pseudo-Lidar representation has significantly narrowed the gap between visual-based and active Lidar-based 3D object detection. However, current researches exclusively focus on pushing the accuracy improv…
3D Object DetectionDepth EstimationObjectobject-detection+3To lie or not to lie in a subspace
Give deterministic necessary and sufficient conditions to guarantee that if a subspace fits certain partially observed data from a union of subspaces, it is because such data really lies in a subspace. Furthermore, Giv…