Refinements in Motion and Appearance for Online Multi-Object Tracking
Modern multi-object tracking (MOT) system usually involves separated modules, such as motion model for location and appearance model for data association. However, the compatible problems within both motion and appearance models are always ignored. In this paper, a general architecture named as MIF is presented by seamlessly blending the Motion integration, three-dimensional(3D) Integral image and adaptive appearance feature Fusion. Since the uncertain pedestrian and camera motions are usually handled separately, the integrated motion model is designed using our defined intension of camera motion. Specifically, a 3D integral image based spatial blocking method is presented to efficiently cut useless connections between trajectories and candidates with spatial constraints. Then the appearance model and visibility prediction are jointly built. Considering scale, pose and visibility, the appearance features are adaptively fused to overcome the feature misalignment problem. Our MIF based tracker (MIFT) achieves the state-of-the-art accuracy with 60.1 MOTA on both MOT16&17 challenges.
Code (0)
등록된 구현이 없습니다.
Tasks
BlockingMulti-Object TrackingObject TrackingOnline Multi-Object TrackingSimilar Papers 제목 키워드 기반
Tackling multiple object tracking with complicated motions—Re-designing the integration of motion and appearance
Although numerous data association methods have been proposed for Multiple Object Tracking (MOT), how to integrate different features in the data association remains an open problem. For instance, over-relying on the mot…
Multiple Object TrackingObjectObject TrackingMulti-object Tracking with Neural Gating Using Bilinear LSTM
In recent deep online and near-online multi-object tracking approaches, a difficulty has been to incorporate long-term appearance models to efficiently score object tracks under severe occlusion and multiple missing dete…
Data AugmentationMulti-Object TrackingMultiple Object TrackingObject+2Simple online and real-time tracking with occlusion handling
Multiple object tracking is a challenging problem in computer vision due to difficulty in dealing with motion prediction, occlusion handling, and object re-identification. Many recent algorithms use motion and appearance…
motion predictionMultiple Object TrackingObjectObject Tracking+1Online Multi-Object Tracking via Structural Constraint Event Aggregation
Multi-object tracking (MOT) becomes more challenging when objects of interest have similar appearances. In that case, the motion cues are particularly useful for discriminating multiple objects. However, for online 2D MO…
Multi-Object TrackingMultiple Object TrackingObjectObject Tracking+1Tracklet Association by Online Target-Specific Metric Learning and Coherent Dynamics Estimation
In this paper, we present a novel method based on online target-specific metric learning and coherent dynamics estimation for tracklet (track fragment) association by network flow optimization in long-term multi-person t…
Metric LearningObject