Learning Target-oriented Dual Attention for Robust RGB-T Tracking
RGB-Thermal object tracking attempt to locate target object using complementary visual and thermal infrared data. Existing RGB-T trackers fuse different modalities by robust feature representation learning or adaptive modal weighting. However, how to integrate dual attention mechanism for visual tracking is still a subject that has not been studied yet. In this paper, we propose two visual attention mechanisms for robust RGB-T object tracking. Specifically, the local attention is implemented by exploiting the common visual attention of RGB and thermal data to train deep classifiers. We also introduce the global attention, which is a multi-modal target-driven attention estimation network. It can provide global proposals for the classifier together with local proposals extracted from previous tracking result. Extensive experiments on two RGB-T benchmark datasets validated the effectiveness of our proposed algorithm.
Code (0)
등록된 구현이 없습니다.
Tasks
ObjectObject TrackingRepresentation LearningRgb-T TrackingVisual TrackingSimilar Papers 제목 키워드 기반
Goal-Oriented UAV Communication Design and Optimization for Target Tracking: A MachineLearning Approach
To accomplish various tasks, safe and smooth control of unmanned aerial vehicles (UAVs) needs to be guaranteed, which cannot be met by existing ultra-reliable low latency communications (URLLC). This has attracted the at…
Deep Reinforcement LearningLearning Attentions: Residual Attentional Siamese Network for High Performance Online Visual Tracking
Offline training for object tracking has recently shown great potentials in balancing tracking accuracy and speed. However, it is still difficult to adapt an offline trained model to a target tracked online. This work pr…
Object TrackingRepresentation LearningVisual TrackingRotaTR: Detection Transformer for Dense and Rotated Object
Detecting the objects in dense and rotated scenes is a challenging task. Recent works on this topic are mostly based on Faster RCNN or Retinanet. As they are highly dependent on the pre-set dense anchors and the NMS oper…
Action RecognitionDecoderObjectobject-detection+1Tracking Feral Horses in Aerial Video Using Oriented Bounding Boxes
The social structures of group-living animals such as feral horses are diverse and remain insufficiently understood, even within a single species. To investigate group dynamics, aerial videos are often utilized to track …
One-Shot Adversarial Attacks on Visual Tracking With Dual Attention
Almost all adversarial attacks in computer vision are aimed at pre-known object categories, which could be offline trained for generating perturbations. But as for visual object tracking, the tracked target categories ar…
Adversarial AttackObjectObject TrackingVisual Object Tracking+1