paper-with-me

홈 › Papers

SwinTrack: A Simple and Strong Baseline for Transformer Tracking

2021-12-02 · Liting Lin, Heng Fan, Zhipeng Zhang, Yong Xu, Haibin Ling

Recently Transformer has been largely explored in tracking and shown state-of-the-art (SOTA) performance. However, existing efforts mainly focus on fusing and enhancing features generated by convolutional neural networks (CNNs). The potential of Transformer in representation learning remains under-explored. In this paper, we aim to further unleash the power of Transformer by proposing a simple yet efficient fully-attentional tracker, dubbed SwinTrack, within classic Siamese framework. In particular, both representation learning and feature fusion in SwinTrack leverage the Transformer architecture, enabling better feature interactions for tracking than pure CNN or hybrid CNN-Transformer frameworks. Besides, to further enhance robustness, we present a novel motion token that embeds historical target trajectory to improve tracking by providing temporal context. Our motion token is lightweight with negligible computation but brings clear gains. In our thorough experiments, SwinTrack exceeds existing approaches on multiple benchmarks. Particularly, on the challenging LaSOT, SwinTrack sets a new record with 0.713 SUC score. It also achieves SOTA results on other benchmarks. We expect SwinTrack to serve as a solid baseline for Transformer tracking and facilitate future research. Our codes and results are released at https://github.com/LitingLin/SwinTrack.

📄 PDF Abstract BibTeX arXiv:2112.00995

Code (1)

litinglin/swintrack 공식 구현 pytorch

Tasks

Representation LearningVisual Object TrackingVisual Tracking

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…

Similar Papers 제목 키워드 기반

Joint Feature Learning and Relation Modeling for Tracking: A One-Stream Framework

2022-03-22 · Botao Ye, Hong Chang, Bingpeng Ma, Shiguang Shan 외

The current popular two-stream, two-stage tracking framework extracts the template and the search region features separately and then performs relation modeling, thus the extracted features lack the awareness of the targ…

Object TrackingRelationVideo Object TrackingVisual Object Tracking+1

TAPTR: Tracking Any Point with Transformers as Detection

2024-03-19 · Hongyang Li, Hao Zhang, Shilong Liu, Zhaoyang Zeng 외

In this paper, we propose a simple and strong framework for Tracking Any Point with TRansformers (TAPTR). Based on the observation that point tracking bears a great resemblance to object detection and tracking, we borrow…

object-detectionObject DetectionOptical Flow EstimationPoint Tracking

Effective Use of Transformer Networks for Entity Tracking

2019-09-05 · IJCNLP 2019 11 · Aditya Gupta, Greg Durrett

Tracking entities in procedural language requires understanding the transformations arising from actions on entities as well as those entities' interactions. While self-attention-based pre-trained language encoders like …

Natural Language Understanding

GoMatching: A Simple Baseline for Video Text Spotting via Long and Short Term Matching

2024-01-13 · Haibin He, Maoyuan Ye, Jing Zhang, Juhua Liu 외

Beyond the text detection and recognition tasks in image text spotting, video text spotting presents an augmented challenge with the inclusion of tracking. While advanced end-to-end trainable methods have shown commendab…

Text DetectionText Spotting

UTPTrack: Towards Simple and Unified Token Pruning for Visual Tracking

2026-02-27 · Hao Wu, Xudong Wang, Jialiang Zhang, Junlong Tong 외 arxiv

One-stream Transformer-based trackers achieve advanced performance in visual object tracking but suffer from significant computational overhead that hinders real-time deployment. While token pruning offers a path to effi…

Visual Object TrackingVisual Tracking