On the Role of Geometry in Geo-Localization
Humans can build a mental map of a geographical area to find their way and recognize places. The basic task we consider is geo-localization - finding the pose (position & orientation) of a camera in a large 3D scene from a single image. We aim to experimentally explore the role of geometry in geo-localization in a convolutional neural network (CNN) solution. We do so by ignoring the often available texture of the scene. We therefore deliberately avoid using texture or rich geometric details and use images projected from a simple 3D model of a city, which we term lean images. Lean images contain solely information that relates to the geometry of the area viewed (edges, faces, or relative depth). We find that the network is capable of estimating the camera pose from the lean images, and it does so not by memorization but by some measure of geometric learning of the geographical area. The main contributions of this paper are: (i) providing insight into the role of geometry in the CNN learning process; and (ii) demonstrating the power of CNNs for recovering camera pose using lean images.
Code (0)
등록된 구현이 없습니다.
Tasks
geo-localizationMemorizationSimilar Papers 제목 키워드 기반
Misspecified Cramér-Rao Bound of RIS-aided Localization under Geometry Mismatch
In 5G/6G wireless systems, reconfigurable intelligent surfaces (RIS) can play a role as a passive anchor to enable and enhance localization in various scenarios. However, most existing RIS-aided localization works assume…
Lean Images for Geo-Localization
Most computer vision tasks use textured images. In this paper we consider the geo-localization task - finding the pose of a camera in a large 3D scene from a single lean image, i.e. an image with no texture. We aim to e…
geo-localizationImproving Feature-based Visual Localization by Geometry-Aided Matching
Feature matching is crucial in visual localization, where 2D-3D correspondence plays a major role in determining the accuracy of camera pose. A sufficient number of well-distributed 2D-3D correspondences is essential for…
3D Feature MatchingPose EstimationVisual LocalizationWeatherproofing Retrieval for Localization with Generative AI and Geometric Consistency
State-of-the-art visual localization approaches generally rely on a first image retrieval step whose role is crucial. Yet, retrieval often struggles when facing varying conditions, due to e.g. weather or time of day, wit…
Image RetrievalRetrievalVisual LocalizationEiffel Tower: A Deep-Sea Underwater Dataset for Long-Term Visual Localization
Visual localization plays an important role in the positioning and navigation of robotics systems within previously visited environments. When visits occur over long periods of time, changes in the environment related to…
Visual Localization