ProContEXT: Exploring Progressive Context Transformer for Tracking
Existing Visual Object Tracking (VOT) only takes the target area in the first frame as a template. This causes tracking to inevitably fail in fast-changing and crowded scenes, as it cannot account for changes in object appearance between frames. To this end, we revamped the tracking framework with Progressive Context Encoding Transformer Tracker (ProContEXT), which coherently exploits spatial and temporal contexts to predict object motion trajectories. Specifically, ProContEXT leverages a context-aware self-attention module to encode the spatial and temporal context, refining and updating the multi-scale static and dynamic templates to progressively perform accurately tracking. It explores the complementary between spatial and temporal context, raising a new pathway to multi-context modeling for transformer-based trackers. In addition, ProContEXT revised the token pruning technique to reduce computational complexity. Extensive experiments on popular benchmark datasets such as GOT-10k and TrackingNet demonstrate that the proposed ProContEXT achieves state-of-the-art performance.
Code (4)
Tasks
ObjectObject TrackingVideo Object TrackingVisual Object TrackingMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
EDTER: Edge Detection with Transformer
Convolutional neural networks have made significant progresses in edge detection by progressively exploring the context and semantic features. However, local details are gradually suppressed with the enlarging of recepti…
DecoderEdge DetectionBeyond Visual Cues: Synchronously Exploring Target-Centric Semantics for Vision-Language Tracking
Single object tracking aims to locate one specific target in video sequences, given its initial state. Classical trackers rely solely on visual cues, restricting their ability to handle challenges such as appearance vari…
Object TrackingRepresentation LearningTransformers Provably Learn Chain-of-Thought Reasoning with Length Generalization
The ability to reason lies at the core of artificial intelligence (AI), and challenging problems usually call for deeper and longer reasoning to tackle. A crucial question about AI reasoning is whether models can extrapo…
Transformer Meets Tracker: Exploiting Temporal Context for Robust Visual Tracking
In video object tracking, there exist rich temporal contexts among successive frames, which have been largely overlooked in existing trackers. In this work, we bridge the individual video frames and explore the temporal …
DecoderObjectObject TrackingVideo Object Tracking+2Exploring Point-BEV Fusion for 3D Point Cloud Object Tracking with Transformer
With the prevalence of LiDAR sensors in autonomous driving, 3D object tracking has received increasing attention. In a point cloud sequence, 3D object tracking aims to predict the location and orientation of an object in…
3D Object TrackingAutonomous DrivingObjectObject Tracking+1