Motion-Aware Transformer for Multi-Object Tracking
Multi-object tracking (MOT) in videos remains challenging due to complex object motions and crowded scenes. Recent DETR-based frameworks offer end-to-end solutions but typically process detection and tracking queries jointly within a single Transformer Decoder layer, leading to conflicts and degraded association accuracy. We introduce the Motion-Aware Transformer (MATR), which explicitly predicts object movements across frames to update track queries in advance. By reducing query collisions, MATR enables more consistent training and improves both detection and association. Extensive experiments on DanceTrack, SportsMOT, and BDD100k show that MATR delivers significant gains across standard metrics. On DanceTrack, MATR improves HOTA by more than 9 points over MOTR without additional data and reaches a new state-of-the-art score of 71.3 with supplementary data. MATR also achieves state-of-the-art results on SportsMOT (72.2 HOTA) and BDD100k (54.7 mTETA, 41.6 mHOTA) without relying on external datasets. These results demonstrate that explicitly modeling motion within end-to-end Transformers offers a simple yet highly effective approach to advancing multi-object tracking.
Code (0)
등록된 구현이 없습니다.
Tasks
Multi-Object TrackingResults from the Paper
| Rank | Task | Dataset | Model | Metrics |
|---|---|---|---|---|
| #4 | Multi-Object Tracking | DanceTrack | Motion-Aware | HOTA: 72.2 |
| #15 | Multi-Object Tracking | SportsMOT | Motion-Aware | HOTA: 72.2 |
Similar Papers 제목 키워드 기반
Delving into Motion-Aware Matching for Monocular 3D Object Tracking
Recent advances of monocular 3D object detection facilitate the 3D multi-object tracking task based on low-cost camera sensors. In this paper, we find that the motion cue of objects along different time frames is critica…
3D Multi-Object Tracking3D Object Detection3D Object TrackingMonocular 3D Object Detection+5ProContEXT: Exploring Progressive Context Transformer for Tracking
Existing Visual Object Tracking (VOT) only takes the target area in the first frame as a template. This causes tracking to inevitably fail in fast-changing and crowded scenes, as it cannot account for changes in object a…
ObjectObject TrackingVideo Object TrackingVisual Object TrackingExploring Point-BEV Fusion for 3D Point Cloud Object Tracking with Transformer
With the prevalence of LiDAR sensors in autonomous driving, 3D object tracking has received increasing attention. In a point cloud sequence, 3D object tracking aims to predict the location and orientation of an object in…
3D Object TrackingAutonomous DrivingObjectObject Tracking+1Distractor-aware Event-based Tracking
Event cameras, or dynamic vision sensors, have recently achieved success from fundamental vision tasks to high-level vision researches. Due to its ability to asynchronously capture light intensity changes, event camera h…
ObjectObject TrackingVisual Object TrackingDynamic Pondering Sparsity-aware Mixture-of-Experts Transformer for Event Stream based Visual Object Tracking
Despite significant progress, RGB-based trackers remain vulnerable to challenging imaging conditions, such as low illumination and fast motion. Event cameras offer a promising alternative by asynchronously capturing pixe…
Computational EfficiencyVisual Object Tracking