Online Multi-Target Tracking Using Recurrent Neural Networks
We present a novel approach to online multi-target tracking based on recurrent neural networks (RNNs). Tracking multiple objects in real-world scenes involves many challenges, including a) an a-priori unknown and time-varying number of targets, b) a continuous state estimation of all present targets, and c) a discrete combinatorial problem of data association. Most previous methods involve complex models that require tedious tuning of parameters. Here, we propose for the first time, an end-to-end learning approach for online multi-target tracking. Existing deep learning methods are not designed for the above challenges and cannot be trivially applied to the task. Our solution addresses all of the above points in a principled way. Experiments on both synthetic and real data show promising results obtained at ~300 Hz on a standard CPU, and pave the way towards future research in this direction.
Code (0)
등록된 구현이 없습니다.
Tasks
CPUState EstimationSimilar Papers 제목 키워드 기반
Recurrent Filter Learning for Visual Tracking
Recently using convolutional neural networks (CNNs) has gained popularity in visual tracking, due to its robust feature representation of images. Recent methods perform online tracking by fine-tuning a pre-trained CNN mo…
ObjectVisual TrackingTracking The Untrackable: Learning To Track Multiple Cues with Long-Term Dependencies
The majority of existing solutions to the Multi-Target Tracking (MTT) problem do not combine cues in a coherent end-to-end fashion over a long period of time. However, we present an online method that encodes long-term t…
Multi-object Tracking with Neural Gating Using Bilinear LSTM
In recent deep online and near-online multi-object tracking approaches, a difficulty has been to incorporate long-term appearance models to efficiently score object tracks under severe occlusion and multiple missing dete…
Data AugmentationMulti-Object TrackingMultiple Object TrackingObject+2Learning to Update for Object Tracking with Recurrent Meta-learner
Model update lies at the heart of object tracking. Generally, model update is formulated as an online learning problem where a target model is learned over the online training set. Our key innovation is to \emph{formulat…
GPUMeta-LearningObject TrackingVisual Object Tracking+1Recurrent Autoregressive Networks for Online Multi-Object Tracking
The main challenge of online multi-object tracking is to reliably associate object trajectories with detections in each video frame based on their tracking history. In this work, we propose the Recurrent Autoregressive N…
Multi-Object TrackingObjectObject TrackingOnline Multi-Object Tracking