paper-with-me

홈 › Papers

Contrastive Learning for Multi-Object Tracking with Transformers

2023-11-14 · Pierre-François De Plaen, Nicola Marinello, Marc Proesmans, Tinne Tuytelaars, Luc van Gool

The DEtection TRansformer (DETR) opened new possibilities for object detection by modeling it as a translation task: converting image features into object-level representations. Previous works typically add expensive modules to DETR to perform Multi-Object Tracking (MOT), resulting in more complicated architectures. We instead show how DETR can be turned into a MOT model by employing an instance-level contrastive loss, a revised sampling strategy and a lightweight assignment method. Our training scheme learns object appearances while preserving detection capabilities and with little overhead. Its performance surpasses the previous state-of-the-art by +2.6 mMOTA on the challenging BDD100K dataset and is comparable to existing transformer-based methods on the MOT17 dataset.

📄 PDF Abstract BibTeX arXiv:2311.08043

Code (1)

pfdp0/ContrasTR 공식 구현 pytorch

Tasks

Contrastive LearningMulti-Object TrackingMultiple Object TrackingObjectobject-detectionObject DetectionObject Tracking

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Residual Connection 설명 없음
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Adam 설명 없음
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…

Similar Papers 제목 키워드 기반

EchoTrack: Auditory Referring Multi-Object Tracking for Autonomous Driving

2024-02-28 · Jiacheng Lin, Jiajun Chen, Kunyu Peng, Xuan He 외

This paper introduces the task of Auditory Referring Multi-Object Tracking (AR-MOT), which dynamically tracks specific objects in a video sequence based on audio expressions and appears as a challenging problem in autono…

Autonomous DrivingMulti-Object TrackingObjectObject Tracking+1

MOTS R-CNN: Cosine-margin-triplet loss for multi-object tracking

2021-02-06 · Amit Satish Unde, Renu M. Rameshan

One of the central tasks of multi-object tracking involves learning a distance metric that is consistent with the semantic similarities of objects. The design of an appropriate loss function that encourages discriminativ…

Metric LearningMulti-Object TrackingMulti-Object Tracking and SegmentationObject Tracking+1

Multi-Object Grounding via Hierarchical Contrastive Siamese Transformers

2025-04-14 · Chengyi Du, Keyan Jin

Multi-object grounding in 3D scenes involves localizing multiple objects based on natural language input. While previous work has primarily focused on single-object grounding, real-world scenarios often demand the locali…

ObjectObject Localization

The Progression of Transformers from Language to Vision to MOT: A Literature Review on Multi-Object Tracking with Transformers

2024-06-24 · Abhi Kamboj

The transformer neural network architecture allows for autoregressive sequence-to-sequence modeling through the use of attention layers. It was originally created with the application of machine translation but has revol…

Machine TranslationMulti-Object TrackingObject TrackingTranslation

ZJU ReLER Submission for EPIC-KITCHEN Challenge 2023: TREK-150 Single Object Tracking

2023-07-05 · Yuanyou Xu, Jiahao Li, Zongxin Yang, Yi Yang 외

The Associating Objects with Transformers (AOT) framework has exhibited exceptional performance in a wide range of complex scenarios for video object tracking and segmentation. In this study, we convert the bounding boxe…

ObjectObject TrackingSegmentationSemantic Segmentation+3