Efficient Visual Tracking with Exemplar Transformers
The design of more complex and powerful neural network models has significantly advanced the state-of-the-art in visual object tracking. These advances can be attributed to deeper networks, or the introduction of new building blocks, such as transformers. However, in the pursuit of increased tracking performance, runtime is often hindered. Furthermore, efficient tracking architectures have received surprisingly little attention. In this paper, we introduce the Exemplar Transformer, a transformer module utilizing a single instance level attention layer for realtime visual object tracking. E.T.Track, our visual tracker that incorporates Exemplar Transformer modules, runs at 47 FPS on a CPU. This is up to 8x faster than other transformer-based models. When compared to lightweight trackers that can operate in realtime on standard CPUs, E.T.Track consistently outperforms all other methods on the LaSOT, OTB-100, NFS, TrackingNet, and VOT-ST2020 datasets. Code and models are available at https://github.com/pblatter/ettrack.
Code (2)
Tasks
CPUObject TrackingVideo Object TrackingVisual Object TrackingVisual TrackingMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Exemplar Loss for Siamese Network in Visual Tracking
Visual tracking plays an important role in perception system, which is a crucial part of intelligent transportation. Recently, Siamese network is a hot topic for visual tracking to estimate moving targets' trajectory, du…
TripletVisual TrackingLearning feed-forward one-shot learners
One-shot learning is usually tackled by using generative models or discriminative embeddings. Discriminative methods based on deep learning, which are very effective in other learning scenarios, are ill-suited for one-sh…
Object TrackingOne-Shot LearningVisual Object TrackingSiamVGG: Visual Tracking using Deeper Siamese Networks
Recently, we have seen a rapid development of Deep Neural Network (DNN) based visual tracking solutions. Some trackers combine the DNN-based solutions with Discriminative Correlation Filters (DCF) to extract semantic fea…
Object TrackingVisual Object TrackingVisual TrackingHallucinated Adversarial Learning for Robust Visual Tracking
Humans can easily learn new concepts from just a single exemplar, mainly due to their remarkable ability to imagine or hallucinate what the unseen exemplar may look like in different settings. Incorporating such an abili…
Visual TrackingExemplar-based Linear Discriminant Analysis for Robust Object Tracking
Tracking-by-detection has become an attractive tracking technique, which treats tracking as a category detection problem. However, the task in tracking is to search for a specific object, rather than an object category a…
ObjectObject Tracking