paper-with-me

홈 › Papers

Leveraging the Power of Data Augmentation for Transformer-based Tracking

2023-09-15 · Jie Zhao, Johan Edstedt, Michael Felsberg, Dong Wang, Huchuan Lu

Due to long-distance correlation and powerful pretrained models, transformer-based methods have initiated a breakthrough in visual object tracking performance. Previous works focus on designing effective architectures suited for tracking, but ignore that data augmentation is equally crucial for training a well-performing model. In this paper, we first explore the impact of general data augmentations on transformer-based trackers via systematic experiments, and reveal the limited effectiveness of these common strategies. Motivated by experimental observations, we then propose two data augmentation methods customized for tracking. First, we optimize existing random cropping via a dynamic search radius mechanism and simulation for boundary samples. Second, we propose a token-level feature mixing augmentation strategy, which enables the model against challenges like background interference. Extensive experiments on two transformer-based trackers and six benchmarks demonstrate the effectiveness and data efficiency of our methods, especially under challenging settings, like one-shot tracking and small image resolutions.

📄 PDF Abstract BibTeX arXiv:2309.08264

Code (0)

등록된 구현이 없습니다.

Tasks

Data AugmentationObject TrackingVisual Object Tracking

Methods 이 논문이 사용한 방법론

Focus 설명 없음

Similar Papers 제목 키워드 기반

Cross-modal Orthogonal High-rank Augmentation for RGB-Event Transformer-trackers

2023-07-09 · ICCV 2023 1 · Zhiyu Zhu, Junhui Hou, Dapeng Oliver Wu

This paper addresses the problem of cross-modal object tracking from RGB videos and event data. Rather than constructing a complex cross-modal fusion network, we explore the great potential of a pre-trained vision Transf…

Object Tracking

Beat and Downbeat Tracking in Performance MIDI Using an End-to-End Transformer Architecture

2025-07-01 · Sebastian Murgul, Michael Heizmann arxiv

Beat tracking in musical performance MIDI is a challenging and important task for notation-level music transcription and rhythmical analysis, yet existing methods primarily focus on audio-based approaches. This paper pro…

Music TranscriptionDownbeat Tracking

SDTrack: A Baseline for Event-based Tracking via Spiking Neural Networks

2025-03-09 · Yimeng Shan, Zhenbang Ren, Haodi Wu, Wenjie Wei 외

Event cameras provide superior temporal resolution, dynamic range, power efficiency, and pixel bandwidth. Spiking Neural Networks (SNNs) naturally complement event data through discrete spike signals, making them ideal f…

Data Augmentation

Spectral-Enhanced Transformers: Leveraging Large-Scale Pretrained Models for Hyperspectral Object Tracking

2025-02-26 · Shaheer Mohamed, Tharindu Fernando, Sridha Sridharan, Peyman Moghadam 외

Hyperspectral object tracking using snapshot mosaic cameras is emerging as it provides enhanced spectral information alongside spatial data, contributing to a more comprehensive understanding of material properties. Usin…

ObjectObject Tracking

Strong-TransCenter: Improved Multi-Object Tracking based on Transformers with Dense Representations

2022-10-24 · Amit Galor, Roy Orfaig, Ben-Zion Bobrovsky

Transformer networks have been a focus of research in many fields in recent years, being able to surpass the state-of-the-art performance in different computer vision tasks. However, in the task of Multiple Object Tracki…

Multi-Object TrackingMultiple Object TrackingMultiple Object Tracking with TransformerObject Tracking