A Transformer-Based Adaptive Semantic Aggregation Method for UAV Visual Geo-Localization
This paper addresses the task of Unmanned Aerial Vehicles (UAV) visual geo-localization, which aims to match images of the same geographic target taken by different platforms, i.e., UAVs and satellites. In general, the key to achieving accurate UAV-satellite image matching lies in extracting visual features that are robust against viewpoint changes, scale variations, and rotations. Current works have shown that part matching is crucial for UAV visual geo-localization since part-level representations can capture image details and help to understand the semantic information of scenes. However, the importance of preserving semantic characteristics in part-level representations is not well discussed. In this paper, we introduce a transformer-based adaptive semantic aggregation method that regards parts as the most representative semantics in an image. Correlations of image patches to different parts are learned in terms of the transformer's feature map. Then our method decomposes part-level features into an adaptive sum of all patch features. By doing this, the learned parts are encouraged to focus on patches with typical semantics. Extensive experiments on the University-1652 dataset have shown the superiority of our method over the current works.
Code (0)
등록된 구현이 없습니다.
Tasks
geo-localizationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Stepping Stones: A Progressive Training Strategy for Audio-Visual Semantic Segmentation
Audio-Visual Segmentation (AVS) aims to achieve pixel-level localization of sound sources in videos, while Audio-Visual Semantic Segmentation (AVSS), as an extension of AVS, further pursues semantic understanding of audi…
Decoderglobal-optimizationSegmentationSemantic SegmentationTowards Mitigating Modality Bias in Vision-Language Models for Temporal Action Localization
Temporal Action Localization (TAL) requires identifying both the boundaries and categories of actions in untrimmed videos. While vision-language models (VLMs) offer rich semantics to complement visual evidence, existing …
Temporal Action LocalizationSpaRC: Sparse Radar-Camera Fusion for 3D Object Detection
In this work, we present SpaRC, a novel Sparse fusion transformer for 3D perception that integrates multi-view image semantics with Radar and Camera point features. The fusion of radar and camera modalities has emerged a…
3D Multi-Object Tracking3D Object DetectionAutonomous DrivingDepth Estimation+3BEV-Locator: An End-to-end Visual Semantic Localization Network Using Multi-View Images
Accurate localization ability is fundamental in autonomous driving. Traditional visual localization frameworks approach the semantic map-matching problem with geometric models, which rely on complex parameter tuning and …
Autonomous DrivingVisual LocalizationBuilding Vision Transformers with Hierarchy Aware Feature Aggregation
Thanks to the excellent global modeling capability of attention mechanisms, the Vision Transformer has achieved better results than ConvNet in many computer tasks. However, in generating hierarchical feature maps, th…
image-classificationImage Classificationobject-detectionObject Detection+1