Accurate 3-DoF Camera Geo-Localization via Ground-to-Satellite Image Matching
We address the problem of ground-to-satellite image geo-localization, that is, estimating the camera latitude, longitude and orientation (azimuth angle) by matching a query image captured at the ground level against a large-scale database with geotagged satellite images. Our prior arts treat the above task as pure image retrieval by selecting the most similar satellite reference image matching the ground-level query image. However, such an approach often produces coarse location estimates because the geotag of the retrieved satellite image only corresponds to the image center while the ground camera can be located at any point within the image. To further consolidate our prior research findings, we present a novel geometry-aware geo-localization method. Our new method is able to achieve the fine-grained location of a query image, up to pixel size precision of the satellite image, once its coarse location and orientation have been determined. Moreover, we propose a new geometry-aware image retrieval pipeline to improve the coarse localization accuracy. Apart from a polar transform in our conference work, this new pipeline also maps satellite image pixels to the ground-level plane in the ground-view via a geometry-constrained projective transform to emphasize informative regions, such as road structures, for cross-view geo-localization. Extensive quantitative and qualitative experiments demonstrate the effectiveness of our newly proposed framework. We also significantly improve the performance of coarse localization results compared to the state-of-the-art in terms of location recalls.
Code (1)
Tasks
geo-localizationImage RetrievalRetrievalSimilar Papers 제목 키워드 기반
Beyond Cross-view Image Retrieval: Highly Accurate Vehicle Localization Using Satellite Image
This paper addresses the problem of vehicle-mounted camera localization by matching a ground-level image with an overhead-view satellite map. Existing methods often treat this problem as cross-view image retrieval, and u…
Camera LocalizationImage RetrievalPose EstimationRetrievalWeakly-supervised Camera Localization by Ground-to-satellite Image Registration
The ground-to-satellite image matching/retrieval was initially proposed for city-scale ground camera localization. This work addresses the problem of improving camera pose accuracy by ground-to-satellite image matching a…
Camera LocalizationContrastive LearningImage RegistrationRetrieval+1Learning Dense Flow Field for Highly-accurate Cross-view Camera Localization
This paper addresses the problem of estimating the 3-DoF camera pose for a ground-level image with respect to a satellite image that encompasses the local surroundings. We propose a novel end-to-end approach that leverag…
Camera LocalizationDecoderOptical Flow EstimationCVLNet: Cross-View Semantic Correspondence Learning for Video-based Camera Localization
This paper tackles the problem of Cross-view Video-based camera Localization (CVL). The task is to localize a query camera by leveraging information from its past observations, i.e., a continuous sequence of images obser…
Camera LocalizationImage-Based LocalizationSemantic correspondenceWrivinder: Towards Spatial Intelligence for Geo-locating Ground Images onto Satellite Imagery
Aligning ground-level imagery with geo-registered satellite maps is crucial for mapping, navigation, and situational awareness, yet remains challenging under large viewpoint gaps or when GPS is unreliable. We introduce W…