Improving Accuracy and Generalization for Efficient Visual Tracking
Efficient visual trackers overfit to their training distributions and lack generalization abilities, resulting in them performing well on their respective in-distribution (ID) test sets and not as well on out-of-distribution (OOD) sequences, imposing limitations to their deployment in-the-wild under constrained resources. We introduce SiamABC, a highly efficient Siamese tracker that significantly improves tracking performance, even on OOD sequences. SiamABC takes advantage of new architectural designs in the way it bridges the dynamic variability of the target, and of new losses for training. Also, it directly addresses OOD tracking generalization by including a fast backward-free dynamic test-time adaptation method that continuously adapts the model according to the dynamic visual changes of the target. Our extensive experiments suggest that SiamABC shows remarkable performance gains in OOD sets while maintaining accurate performance on the ID benchmarks. SiamABC outperforms MixFormerV2-S by 7.6\% on the OOD AVisT benchmark while being 3x faster (100 FPS) on a CPU. Our code and models are available at https://wvuvl.github.io/SiamABC/.
Code (0)
등록된 구현이 없습니다.
Tasks
CPUTest-time AdaptationVisual TrackingSimilar Papers 제목 키워드 기반
Parallel Tracking and Verifying: A Framework for Real-Time and High Accuracy Visual Tracking
Being intensively studied, visual tracking has seen great recent advances in either speed (e.g., with correlation filters) or accuracy (e.g., with deep features). Real-time and high accuracy tracking algorithms, however,…
Visual TrackingProgressive Scaling Visual Object Tracking
In this work, we propose a progressive scaling training strategy for visual object tracking, systematically analyzing the influence of training data volume, model size, and input resolution on tracking performance. Our e…
ObjectObject TrackingVisual Object Tracking3D Visual Tracking Framework with Deep Learning for Asteroid Exploration
3D visual tracking is significant to deep space exploration programs, which can guarantee spacecraft to flexibly approach the target. In this paper, we focus on the studied accurate and real-time method for 3D tracking. …
Deep LearningVisual TrackingGeneralizing Multiple Object Tracking to Unseen Domains by Introducing Natural Language Representation
Although existing multi-object tracking (MOT) algorithms have obtained competitive performance on various benchmarks, almost all of them train and validate models on the same domain. The domain generalization problem of …
Domain GeneralizationMulti-Object TrackingMultiple Object TrackingObject TrackingParallel Tracking and Verifying
Being intensively studied, visual object tracking has witnessed great advances in either speed (e.g., with correlation filters) or accuracy (e.g., with deep features). Real-time and high accuracy tracking algorithms, how…
Object TrackingVisual Object Tracking