Self-Supervised Tracking via Target-Aware Data Synthesis
While deep-learning based tracking methods have achieved substantial progress, they entail large-scale and high-quality annotated data for sufficient training. To eliminate expensive and exhaustive annotation, we study self-supervised learning for visual tracking. In this work, we develop the Crop-Transform-Paste operation, which is able to synthesize sufficient training data by simulating various appearance variations during tracking, including appearance variations of objects and background interference. Since the target state is known in all synthesized data, existing deep trackers can be trained in routine ways using the synthesized data without human annotation. The proposed target-aware data-synthesis method adapts existing tracking approaches within a self-supervised learning framework without algorithmic changes. Thus, the proposed self-supervised learning mechanism can be seamlessly integrated into existing tracking frameworks to perform training. Extensive experiments show that our method 1) achieves favorable performance against supervised learning schemes under the cases with limited annotations; 2) helps deal with various tracking challenges such as object deformation, occlusion, or background clutter due to its manipulability; 3) performs favorably against state-of-the-art unsupervised tracking methods; 4) boosts the performance of various state-of-the-art supervised learning frameworks, including SiamRPN++, DiMP, and TransT.
Code (0)
등록된 구현이 없습니다.
Tasks
Representation LearningSelf-Supervised LearningVisual TrackingSimilar Papers 제목 키워드 기반
Semantic-Aware Fine-Grained Correspondence
Establishing visual correspondence across images is a challenging and essential task. Recently, an influx of self-supervised methods have been proposed to better learn representations for visual correspondence. However, …
Pose TrackingSelf-Supervised LearningSemantic correspondenceSemantic Segmentation+2Uncertainty-aware Self-supervised 3D Data Association
3D object trackers usually require training on large amounts of annotated data that is expensive and time-consuming to collect. Instead, we propose leveraging vast unlabeled datasets by self-supervised metric learning of…
Metric LearningObjectobject-detectionObject DetectionMulti-Drone based Single Object Tracking with Agent Sharing Network
Drone equipped with cameras can dynamically track the target in the air from a broader view compared with static cameras or moving sensors over the ground. However, it is still challenging to accurately track the target …
Object TrackingLearning to Track Instance from Single Nature Language Description
How to achieve vision-language (VL) tracking using natural language descriptions from a video sequence \textbf{without relying on any bounding-box ground truth}? In this work, we achieve this goal by tackling \textit{sel…
Self-Supervised LearningUTOPIA: Unconstrained Tracking Objects without Preliminary Examination via Cross-Domain Adaptation
Multiple Object Tracking (MOT) aims to find bounding boxes and identities of targeted objects in consecutive video frames. While fully-supervised MOT methods have achieved high accuracy on existing datasets, they cannot …
Domain AdaptationMultiple Object TrackingObject TrackingSelf-Supervised Learning