Tracking Holistic Object Representations
Recent advances in visual tracking are based on siamese feature extractors and template matching. For this category of trackers, latest research focuses on better feature embeddings and similarity measures. In this work, we focus on building holistic object representations for tracking. We propose a framework that is designed to be used on top of previous trackers without any need for further training of the siamese network. The framework leverages the idea of obtaining additional object templates during the tracking process. Since the number of stored templates is limited, our method only keeps the most diverse ones. We achieve this by providing a new diversity measure in the space of siamese features. The obtained representation contains information beyond the ground truth object location provided to the system. It is then useful for tracking itself but also for further tasks which require a visual understanding of objects. Strong empirical results on tracking benchmarks indicate that our method can improve the performance and robustness of the underlying trackers while barely reducing their speed. In addition, our method is able to match current state-of-the-art results, while using a simpler and older network architecture and running three times faster.
Code (2)
Tasks
DiversityObjectTemplate MatchingVisual Object TrackingVisual TrackingSimilar Papers 제목 키워드 기반
DARTH: Holistic Test-time Adaptation for Multiple Object Tracking
Multiple object tracking (MOT) is a fundamental component of perception systems for autonomous driving, and its robustness to unseen conditions is a requirement to avoid life-critical failures. Despite the urge of safety…
Autonomous DrivingMultiple Object TrackingObjectobject-detection+3UniTrack: Differentiable Graph Representation Learning for Multi-Object Tracking
We present UniTrack, a plug-and-play graph-theoretic loss function designed to significantly enhance multi-object tracking (MOT) performance by directly optimizing tracking-specific objectives through unified differentia…
Graph Representation LearningMulti-Object TrackingSaliency-Associated Object Tracking
Most existing trackers based on deep learning perform tracking in a holistic strategy, which aims to learn deep representations of the whole target for localizing the target. It is arduous for such methods to track targe…
ObjectObject TrackingState EstimationStructural Sparse Tracking
Sparse representation has been applied to visual tracking by finding the best target candidate with minimal reconstruction error by use of target templates. However, most sparse representation based trackers only conside…
Visual TrackingCognitive Disentanglement for Referring Multi-Object Tracking
As a significant application of multi-source information fusion in intelligent transportation perception systems, Referring Multi-Object Tracking (RMOT) involves localizing and tracking specific objects in video sequence…
DisentanglementMulti-Object TrackingObjectObject Tracking+2