Learning data association without data association: An EM approach to neural assignment prediction
Data association is a fundamental component of effective multi-object tracking. Current approaches to data-association tend to frame this as an assignment problem relying on gating and distance-based cost matrices, or offset the challenge of data association to a problem of tracking by detection. The latter is typically formulated as a supervised learning problem, and requires labelling information about tracked object identities to train a model for object recognition. This paper introduces an expectation maximisation approach to train neural models for data association, which does not require labelling information. Here, a Sinkhorn network is trained to predict assignment matrices that maximise the marginal likelihood of trajectory observations. Importantly, networks trained using the proposed approach can be re-used in downstream tracking applications.
Code (0)
등록된 구현이 없습니다.
Tasks
Multi-Object TrackingObjectObject RecognitionObject TrackingSimilar Papers 제목 키워드 기반
Machine Learning Methods for Data Association in Multi-Object Tracking
Data association is a key step within the multi-object tracking pipeline that is notoriously challenging due to its combinatorial nature. A popular and general way to formulate data association is as the NP-hard multidim…
BIG-bench Machine LearningCombinatorial OptimizationMulti-Object TrackingObject Tracking+2S$^3$Track: Self-supervised Tracking with Soft Assignment Flow
In this work, we study self-supervised multiple object tracking without using any video-level association labels. We propose to cast the problem of multiple object tracking as learning the frame-wise associations between…
Multiple Object TrackingObjectObject TrackingOptical Flow EstimationTransformer-based assignment decision network for multiple object tracking
Data association is a crucial component for any multiple object tracking (MOT) method that follows the tracking-by-detection paradigm. To generate complete trajectories such methods employ a data association process to e…
Multi-Object TrackingMultiple Object TrackingObject TrackingOcclusion Handling+1Ranking vs. Assignment: The Metric Mismatch in Multi-View Object Association
Multi-view object association is an important computer vision problem that underlies many multi-camera perception tasks. While this task is naturally formulated as a constrained one-to-one matching problem, recent works …
Transferable and Distributed User Association Policies for 5G and Beyond Networks
We study the problem of user association, namely finding the optimal assignment of user equipment to base stations to achieve a targeted network performance. In this paper, we focus on the knowledge transferability of as…
ManagementMulti-agent Reinforcement LearningZero-shot Generalization