Quasi-Dense Similarity Learning for Multiple Object Tracking
Similarity learning has been recognized as a crucial step for object tracking. However, existing multiple object tracking methods only use sparse ground truth matching as the training objective, while ignoring the majority of the informative regions on the images. In this paper, we present Quasi-Dense Similarity Learning, which densely samples hundreds of region proposals on a pair of images for contrastive learning. We can directly combine this similarity learning with existing detection methods to build Quasi-Dense Tracking (QDTrack) without turning to displacement regression or motion priors. We also find that the resulting distinctive feature space admits a simple nearest neighbor search at the inference time. Despite its simplicity, QDTrack outperforms all existing methods on MOT, BDD100K, Waymo, and TAO tracking benchmarks. It achieves 68.7 MOTA at 20.3 FPS on MOT17 without using external training data. Compared to methods with similar detectors, it boosts almost 10 points of MOTA and significantly decreases the number of ID switches on BDD100K and Waymo datasets. Our code and trained models are available at http://vis.xyz/pub/qdtrack.
Code (3)
Tasks
Contrastive LearningMetric LearningMulti-Object TrackingMultiple Object TrackingObjectObject DetectionObject TrackingOne-Shot Object DetectionSimilar Papers 제목 키워드 기반
QDTrack: Quasi-Dense Similarity Learning for Appearance-Only Multiple Object Tracking
Similarity learning has been recognized as a crucial step for object tracking. However, existing multiple object tracking methods only use sparse ground truth matching as the training objective, while ignoring the majori…
Contrastive LearningMultiple Object TrackingObjectObject TrackingMonocular Quasi-Dense 3D Object Tracking
A reliable and accurate 3D tracking framework is essential for predicting future locations of surrounding objects and planning the observer's actions in numerous applications such as autonomous driving. We propose a fram…
3D Object TrackingAutonomous DrivingMultiple Object TrackingObject+2GOSPA and T-GOSPA quasi-metrics for evaluation of multi-object tracking algorithms
This paper introduces two quasi-metrics for performance assessment of multi-object tracking (MOT) algorithms. One quasi-metric is an extension of the generalised optimal subpattern assignment (GOSPA) metric and measures …
Multi-Object TrackingDense Scene Multiple Object Tracking with Box-Plane Matching
Multiple Object Tracking (MOT) is an important task in computer vision. MOT is still challenging due to the occlusion problem, especially in dense scenes. Following the tracking-by-detection framework, we propose the Box…
Multiple Object TrackingObjectObject TrackingWalker: Self-supervised Multiple Object Tracking by Walking on Temporal Appearance Graphs
The supervision of state-of-the-art multiple object tracking (MOT) methods requires enormous annotation efforts to provide bounding boxes for all frames of all videos, and instance IDs to associate them through time. To …
Multiple Object TrackingObject Tracking