Contrastive Learning for Multi-Object Tracking with Transformers
The DEtection TRansformer (DETR) opened new possibilities for object detection by modeling it as a translation task: converting image features into object-level representations. Previous works typically add expensive modules to DETR to perform Multi-Object Tracking (MOT), resulting in more complicated architectures. We instead show how DETR can be turned into a MOT model by employing an instance-level contrastive loss, a revised sampling strategy and a lightweight assignment method. Our training scheme learns object appearances while preserving detection capabilities and with little overhead. Its performance surpasses the previous state-of-the-art by +2.6 mMOTA on the challenging BDD100K dataset and is comparable to existing transformer-based methods on the MOT17 dataset.
Code (1)
Tasks
Contrastive LearningMulti-Object TrackingMultiple Object TrackingObjectobject-detectionObject DetectionObject TrackingMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
EchoTrack: Auditory Referring Multi-Object Tracking for Autonomous Driving
This paper introduces the task of Auditory Referring Multi-Object Tracking (AR-MOT), which dynamically tracks specific objects in a video sequence based on audio expressions and appears as a challenging problem in autono…
Autonomous DrivingMulti-Object TrackingObjectObject Tracking+1MOTS R-CNN: Cosine-margin-triplet loss for multi-object tracking
One of the central tasks of multi-object tracking involves learning a distance metric that is consistent with the semantic similarities of objects. The design of an appropriate loss function that encourages discriminativ…
Metric LearningMulti-Object TrackingMulti-Object Tracking and SegmentationObject Tracking+1Multi-Object Grounding via Hierarchical Contrastive Siamese Transformers
Multi-object grounding in 3D scenes involves localizing multiple objects based on natural language input. While previous work has primarily focused on single-object grounding, real-world scenarios often demand the locali…
ObjectObject LocalizationThe Progression of Transformers from Language to Vision to MOT: A Literature Review on Multi-Object Tracking with Transformers
The transformer neural network architecture allows for autoregressive sequence-to-sequence modeling through the use of attention layers. It was originally created with the application of machine translation but has revol…
Machine TranslationMulti-Object TrackingObject TrackingTranslationZJU ReLER Submission for EPIC-KITCHEN Challenge 2023: TREK-150 Single Object Tracking
The Associating Objects with Transformers (AOT) framework has exhibited exceptional performance in a wide range of complex scenarios for video object tracking and segmentation. In this study, we convert the bounding boxe…
ObjectObject TrackingSegmentationSemantic Segmentation+3