Deep Network Flow for Multi-Object Tracking
Data association problems are an important component of many computer vision applications, with multi-object tracking being one of the most prominent examples. A typical approach to data association involves finding a graph matching or network flow that minimizes a sum of pairwise association costs, which are often either hand-crafted or learned as linear functions of fixed features. In this work, we demonstrate that it is possible to learn features for network-flow-based data association via backpropagation, by expressing the optimum of a smoothed network flow problem as a differentiable function of the pairwise association costs. We apply this approach to multi-object tracking with a network flow formulation. Our experiments demonstrate that we are able to successfully learn all cost functions for the association problem in an end-to-end fashion, which outperform hand-crafted costs in all settings. The integration and combination of various sources of inputs becomes easy and the cost functions can be learned entirely from data, alleviating tedious hand-designing of costs.
Code (0)
등록된 구현이 없습니다.
Tasks
Graph MatchingMulti-Object TrackingObjectObject TrackingSimilar Papers 제목 키워드 기반
On Pairwise Costs for Network Flow Multi-Object Tracking
Multi-object tracking has been recently approached with the min-cost network flow optimization techniques. Such methods simultaneously resolve multiple object tracks in a video and enable modeling of dependencies among t…
Multi-Object TrackingObjectObject TrackingObject Tracking in Satellite Videos Based on a Multi-Frame Optical Flow Tracker
Object tracking is a hot topic in computer vision. Thanks to the booming of the very high resolution (VHR) remote sensing techniques, it is now possible to track targets of interests in satellite videos. However, since t…
ObjectObject TrackingOptical Flow EstimationRobust Instance Tracking via Uncertainty Flow
Current state-of-the-art trackers often fail due to distractorsand large object appearance changes. In this work, we explore the use ofdense optical flow to improve tracking robustness. Our main insight is that, because …
Optical Flow EstimationTracking-by-Counting: Using Network Flows on Crowd Density Maps for Tracking Multiple Targets
State-of-the-art multi-object tracking~(MOT) methods follow the tracking-by-detection paradigm, where object trajectories are obtained by associating per-frame outputs of object detectors. In crowded scenes, however, det…
Cell TrackingMulti-Object TrackingObjectObject TrackingMultiple Object Tracking by Flowing and Fusing
Most of Multiple Object Tracking (MOT) approaches compute individual target features for two subtasks: estimating target-wise motions and conducting pair-wise Re-Identification (Re-ID). Because of the indefinite number o…
Multiple Object TrackingObjectobject-detectionObject Detection+1