Towards Sequence-Level Training for Visual Tracking
Despite the extensive adoption of machine learning on the task of visual object tracking, recent learning-based approaches have largely overlooked the fact that visual tracking is a sequence-level task in its nature; they rely heavily on frame-level training, which inevitably induces inconsistency between training and testing in terms of both data distributions and task objectives. This work introduces a sequence-level training strategy for visual tracking based on reinforcement learning and discusses how a sequence-level design of data sampling, learning objectives, and data augmentation can improve the accuracy and robustness of tracking algorithms. Our experiments on standard benchmarks including LaSOT, TrackingNet, and GOT-10k demonstrate that four representative tracking models, SiamRPN++, SiamAttn, TransT, and TrDiMP, consistently improve by incorporating the proposed methods in training without modifying architectures.
Code (2)
Tasks
Data AugmentationObject TrackingReinforcement Learning (RL)Video Object TrackingVisual Object TrackingSimilar Papers 제목 키워드 기반
Multi-Cue Visual Tracking Using Robust Feature-Level Fusion Based on Joint Sparse Representation
The use of multiple features for tracking has been proved as an effective approach because limitation of each feature could be compensated. Since different types of variations such as illumination, occlusion and pose may…
Visual TrackingAutoregressive Sequential Pretraining for Visual Tracking
Recent advancements in visual object tracking have shifted towards a sequential generation paradigm, where object deformation and motion exhibit strong temporal dependencies. Despite the importance of these dependenc…
ObjectObject TrackingVisual Object TrackingVisual TrackingPredicting the Best of N Visual Trackers
We observe that the performance of SOTA visual trackers surprisingly strongly varies across different video attributes and datasets. No single tracker remains the best performer across all tracking attributes and dataset…
Self-Supervised LearningMLVSNet: Multi-Level Voting Siamese Network for 3D Visual Tracking
Benefiting from the excellent performance of Siamese-based trackers, huge progress on 2D visual tracking has been achieved. However, 3D visual tracking is still under-explored. Inspired by the idea of Hough voting in…
3D Object Detectionobject-detectionObject DetectionVisual Tracking360VOTS: Visual Object Tracking and Segmentation in Omnidirectional Videos
Visual object tracking and segmentation in omnidirectional videos are challenging due to the wide field-of-view and large spherical distortion brought by 360{\deg} images. To alleviate these problems, we introduce a nove…
ObjectObject TrackingSegmentationSemantic Segmentation+3