Multi-Object Tracking as Attention Mechanism
We propose a conceptually simple and thus fast multi-object tracking (MOT) model that does not require any attached modules, such as the Kalman filter, Hungarian algorithm, transformer blocks, or graph networks. Conventional MOT models are built upon the multi-step modules listed above, and thus the computational cost is high. Our proposed end-to-end MOT model, \textit{TicrossNet}, is composed of a base detector and a cross-attention module only. As a result, the overhead of tracking does not increase significantly even when the number of instances ($N_t$) increases. We show that TicrossNet runs \textit{in real-time}; specifically, it achieves 32.6 FPS on MOT17 and 31.0 FPS on MOT20 (Tesla V100), which includes as many as $>$100 instances per frame. We also demonstrate that TicrossNet is robust to $N_t$; thus, it does not have to change the size of the base detector, depending on $N_t$, as is often done by other models for real-time processing.
Code (0)
등록된 구현이 없습니다.
Tasks
Multi-Object TrackingObjectObject TrackingMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Learning Target-oriented Dual Attention for Robust RGB-T Tracking
RGB-Thermal object tracking attempt to locate target object using complementary visual and thermal infrared data. Existing RGB-T trackers fuse different modalities by robust feature representation learning or adaptive mo…
ObjectObject TrackingRepresentation LearningRgb-T Tracking+1GateMOT: Q-Gated Attention for Dense Object Tracking
While large models demonstrate the strong representational power of vanilla attention, this core mechanism cannot be directly applied to Dense Object Tracking: its quadratic all-to-all interactions are computationally pr…
Object TrackingTracking by Joint Local and Global Search: A Target-aware Attention based Approach
Tracking-by-detection is a very popular framework for single object tracking which attempts to search the target object within a local search window for each frame. Although such local search mechanism works well on simp…
DecoderObjectObject TrackingOnline Multi-Object Tracking with Dual Matching Attention Networks
In this paper, we propose an online Multi-Object Tracking (MOT) approach which integrates the merits of single object tracking and data association methods in a unified framework to handle noisy detections and frequent i…
Multi-Object TrackingObjectObject TrackingOnline Multi-Object TrackingLooking Beyond Two Frames: End-to-End Multi-Object Tracking Using Spatial and Temporal Transformers
Tracking a time-varying indefinite number of objects in a video sequence over time remains a challenge despite recent advances in the field. Most existing approaches are not able to properly handle multi-object tracking …
Multi-Object TrackingObjectObject TrackingOnline Multi-Object Tracking