PatchTrack: Multiple Object Tracking Using Frame Patches
Object motion and object appearance are commonly used information in multiple object tracking (MOT) applications, either for associating detections across frames in tracking-by-detection methods or direct track predictions for joint-detection-and-tracking methods. However, not only are these two types of information often considered separately, but also they do not help optimize the usage of visual information from the current frame of interest directly. In this paper, we present PatchTrack, a Transformer-based joint-detection-and-tracking system that predicts tracks using patches of the current frame of interest. We use the Kalman filter to predict the locations of existing tracks in the current frame from the previous frame. Patches cropped from the predicted bounding boxes are sent to the Transformer decoder to infer new tracks. By utilizing both object motion and object appearance information encoded in patches, the proposed method pays more attention to where new tracks are more likely to occur. We show the effectiveness of PatchTrack on recent MOT benchmarks, including MOT16 (MOTA 73.71%, IDF1 65.77%) and MOT17 (MOTA 73.59%, IDF1 65.23%). The results are published on https://motchallenge.net/method/MOT=4725&chl=10.
Code (0)
등록된 구현이 없습니다.
Tasks
DecoderMultiple Object TrackingObjectObject TrackingMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Non-Rigid Object Tracking via Deformable Patches Using Shape-Preserved KCF and Level Sets
Part-based trackers are effective in exploiting local details of the target object for robust tracking. In contrast to most existing part-based methods that divide all kinds of target objects into a number of fixed recta…
Object TrackingLearning Hierarchical Features for Visual Object Tracking with Recursive Neural Networks
Recently, deep learning has achieved very promising results in visual object tracking. Deep neural networks in existing tracking methods require a lot of training data to learn a large number of parameters. However, trai…
ObjectObject TrackingVisual Object TrackingReliable Patch Trackers: Robust Visual Tracking by Exploiting Reliable Patches
Most modern trackers typically employ a bounding box given in the first frame to track visual objects, where their tracking results are often sensitive to the initialization. In this paper, we propose a new tracking meth…
ClusteringVisual TrackingSOWP: Spatially Ordered and Weighted Patch Descriptor for Visual Tracking
A simple yet effective object descriptor for visual tracking is proposed in this paper. We first decompose the bounding box of a target object into multiple patches, which are described by color and gradient histograms. …
ObjectVisual TrackingPart-based Tracking by Sampling
We propose a novel part-based method for tracking an arbitrary object in challenging video sequences. The colour distribution of tracked image patches on the target object are represented by pairs of RGB samples and coun…
Object