Target-aware Bidirectional Fusion Transformer for Aerial Object Tracking
The trackers based on lightweight neural networks have achieved great success in the field of aerial remote sensing, most of which aggregate multi-stage deep features to lift the tracking quality. However, existing algorithms usually only generate single-stage fusion features for state decision, which ignore that diverse kinds of features are required for identifying and locating the object, limiting the robustness and precision of tracking. In this paper, we propose a novel target-aware Bidirectional Fusion transformer (BFTrans) for UAV tracking. Specifically, we first present a two-stream fusion network based on linear self and cross attentions, which can combine the shallow and the deep features from both forward and backward directions, providing the adjusted local details for location and global semantics for recognition. Besides, a target-aware positional encoding strategy is designed for the above fusion model, which is helpful to perceive the object-related attributes during the fusion phase. Finally, the proposed method is evaluated on several popular UAV benchmarks, including UAV-123, UAV20L and UAVTrack112. Massive experimental results demonstrate that our approach can exceed other state-of-the-art trackers and run with an average speed of 30.5 FPS on embedded platform, which is appropriate for practical drone deployments.
Code (0)
등록된 구현이 없습니다.
Tasks
Object TrackingMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Scale-wise Bidirectional Alignment Network for Referring Remote Sensing Image Segmentation
The goal of referring remote sensing image segmentation (RRSIS) is to extract specific pixel-level regions within an aerial image via a natural language expression. Recent advancements, particularly Transformer-based fus…
feature selectionImage SegmentationSemantic SegmentationTarget-Grounded Graph-Aware Transformer for Aerial Vision-and-Dialog Navigation
This report details the methods of the winning entry of the AVDN Challenge in ICCV CLVL 2023. The competition addresses the Aerial Navigation from Dialog History (ANDH) task, which requires a drone agent to associate dia…
Visual GroundingTAFormer: A Unified Target-Aware Transformer for Video and Motion Joint Prediction in Aerial Scenes
As drone technology advances, using unmanned aerial vehicles for aerial surveys has become the dominant trend in modern low-altitude remote sensing. The surge in aerial video data necessitates accurate prediction for fut…
Disaster ResponseObject TrackingPredictionVideo PredictionHiFT: Hierarchical Feature Transformer for Aerial Tracking
Most existing Siamese-based tracking methods execute the classification and regression of the target object based on the similarity maps. However, they either employ a single map from the last convolutional layer which d…
Decision MakingFS-Diff: Semantic guidance and clarity-aware simultaneous multimodal image fusion and super-resolution
As an influential information fusion and low-level vision technique, image fusion integrates complementary information from source images to yield an informative fused image. A few attempts have been made in recent years…