Ground-to-Aerial Image Geo-Localization With a Hard Exemplar Reweighting Triplet Loss
The task of ground-to-aerial image geo-localization can be achieved by matching a ground view query image to a reference database of aerial/satellite images. It is highly challenging due to the dramatic viewpoint changes and unknown orientations. In this paper, we propose a novel in-batch reweighting triplet loss to emphasize the positive effect of hard exemplars during end-to-end training. We also integrate an attention mechanism into our model using feature-level contextual information. To analyze the difficulty level of each triplet, we first enforce a modified logistic regression to triplets with a distance rectifying factor. Then, the reference negative distances for corresponding anchors are set, and the relative weights of triplets are computed by comparing their difficulty to the corresponding references. To reduce the influence of extreme hard data and less useful simple exemplars, the final weights are pruned using upper and lower bound constraints. Experiments on two benchmark datasets show that the proposed approach significantly outperforms the state-of-the-art methods.
Code (0)
등록된 구현이 없습니다.
Tasks
geo-localizationTripletMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
GeoCapsNet: Aerial to Ground view Image Geo-localization using Capsule Network
The task of cross-view image geo-localization aims to determine the geo-location (GPS coordinates) of a query ground-view image by matching it with the GPS-tagged aerial (satellite) images in a reference dataset. Due to …
geo-localizationImage RetrievalRetrievalTripletContinuous Self-Localization on Aerial Images Using Visual and Lidar Sensors
This paper proposes a novel method for geo-tracking, i.e. continuous metric self-localization in outdoor environments by registering a vehicle's sensor information with aerial imagery of an unseen target region. Geo-trac…
Metric LearningBEVLoc: Cross-View Localization and Matching via Birds-Eye-View Synthesis
Ground to aerial matching is a crucial and challenging task in outdoor robotics, particularly when GPS is absent or unreliable. Structures like buildings or large dense forests create interference, requiring GNSS replace…
Autonomous DrivingContrastive LearningTransLocNet: Cross-Modal Attention for Aerial-Ground Vehicle Localization with Contrastive Learning
Aerial-ground localization is difficult due to large viewpoint and modality gaps between ground-level LiDAR and overhead imagery. We propose TransLocNet, a cross-modal attention framework that fuses LiDAR geometry with a…
Contrastive LearningWide-Area Image Geolocalization with Aerial Reference Imagery
We propose to use deep convolutional neural networks to address the problem of cross-view image geolocalization, in which the geolocation of a ground-level query image is estimated by matching to georeferenced aerial ima…