On Designing Light-Weight Object Trackers through Network Pruning: Use CNNs or Transformers?
Object trackers deployed on low-power devices need to be light-weight, however, most of the current state-of-the-art (SOTA) methods rely on using compute-heavy backbones built using CNNs or transformers. Large sizes of such models do not allow their deployment in low-power conditions and designing compressed variants of large tracking models is of great importance. This paper demonstrates how highly compressed light-weight object trackers can be designed using neural architectural pruning of large CNN and transformer based trackers. Further, a comparative study on architectural choices best suited to design light-weight trackers is provided. A comparison between SOTA trackers using CNNs, transformers as well as the combination of the two is presented to study their stability at various compression ratios. Finally results for extreme pruning scenarios going as low as 1% in some cases are shown to study the limits of network pruning in object tracking. This work provides deeper insights into designing highly efficient trackers from existing SOTA methods.
Code (1)
Tasks
Network PruningObjectObject TrackingMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
LightTrack: Finding Lightweight Neural Networks for Object Tracking via One-Shot Architecture Search
Object tracking has achieved significant progress over the past few years. However, state-of-the-art trackers become increasingly heavy and expensive, which limits their deployments in resource-constrained applications. …
GPUNeural Architecture SearchObjectObject Tracking+1Improving Siamese Based Trackers with Light or No Training through Multiple Templates and Temporal Network
High computational power and significant time are usually needed to train a deep learning based tracker on large datasets. Depending on many factors, training might not always be an option. In this paper, we propose a fr…
Object TrackingVisual Object TrackingCFTrack: Enhancing Lightweight Visual Tracking through Contrastive Learning and Feature Matching
Achieving both efficiency and strong discriminative ability in lightweight visual tracking is a challenge, especially on mobile and edge devices with limited computational resources. Conventional lightweight trackers oft…
Contrastive LearningVisual TrackingDeep Learning-based Lightweight RGB Object Tracking for Augmented Reality Devices
Augmented Reality (AR) applications often require robust real-time tracking of objects in the user's environment to correctly overlay virtual content. Recent advances in computer vision have produced highly accurate deep…
Knowledge DistillationObject TrackingMobile Vision Transformer-based Visual Object Tracking
The introduction of robust backbones, such as Vision Transformers, has improved the performance of object tracking algorithms in recent years. However, these state-of-the-art trackers are computationally expensive since …
GPUObjectObject TrackingVisual Object Tracking