Unsupervised Multiple-Object Tracking with a Dynamical Variational Autoencoder
In this paper, we present an unsupervised probabilistic model and associated estimation algorithm for multi-object tracking (MOT) based on a dynamical variational autoencoder (DVAE), called DVAE-UMOT. The DVAE is a latent-variable deep generative model that can be seen as an extension of the variational autoencoder for the modeling of temporal sequences. It is included in DVAE-UMOT to model the objects' dynamics, after being pre-trained on an unlabeled synthetic dataset of single-object trajectories. Then the distributions and parameters of DVAE-UMOT are estimated on each multi-object sequence to track using the principles of variational inference: Definition of an approximate posterior distribution of the latent variables and maximization of the corresponding evidence lower bound of the data likehood function. DVAE-UMOT is shown experimentally to compete well with and even surpass the performance of two state-of-the-art probabilistic MOT models. Code and data are publicly available.
Code (0)
등록된 구현이 없습니다.
Tasks
Multi-Object TrackingMultiple Object TrackingObjectObject TrackingTemporal SequencesVariational InferenceSimilar Papers 제목 키워드 기반
Depth Perspective-aware Multiple Object Tracking
This paper aims to tackle Multiple Object Tracking (MOT), an important problem in computer vision but remains challenging due to many practical issues, especially occlusions. Indeed, we propose a new real-time Depth Pers…
Depth EstimationMultiple Object TrackingObjectObject TrackingMixture of Dynamical Variational Autoencoders for Multi-Source Trajectory Modeling and Separation
In this paper, we propose a latent-variable generative model called mixture of dynamical variational autoencoders (MixDVAE) to model the dynamics of a system composed of multiple moving sources. A DVAE model is pre-train…
Audio Source SeparationMulti-Object TrackingObject TrackingTrajectory ModelingAn On-line Variational Bayesian Model for Multi-Person Tracking from Cluttered Scenes
Object tracking is an ubiquitous problem that appears in many applications such as remote sensing, audio processing, computer vision, human-machine interfaces, human-robot interaction, etc. Although thoroughly investigat…
Multiple Object TrackingObjectObject TrackingRobust Unsupervised Multi-Object Tracking in Noisy Environments
Physical processes, camera movement, and unpredictable environmental conditions like the presence of dust can induce noise and artifacts in video feeds. We observe that popular unsupervised MOT methods are dependent on n…
Multi-Object TrackingObjectObject TrackingVariational InferenceVariational Tracking and Redetection for Closely-spaced Objects in Heavy Clutter: Supplementary Materials
The non-homogeneous Poisson process (NHPP) is a widely used measurement model that allows for an object to generate multiple measurements over time. However, it can be difficult to efficiently and reliably track multiple…