Diff-Tracker: Text-to-Image Diffusion Models are Unsupervised Trackers
We introduce Diff-Tracker, a novel approach for the challenging unsupervised visual tracking task leveraging the pre-trained text-to-image diffusion model. Our main idea is to leverage the rich knowledge encapsulated within the pre-trained diffusion model, such as the understanding of image semantics and structural information, to address unsupervised visual tracking. To this end, we design an initial prompt learner to enable the diffusion model to recognize the tracking target by learning a prompt representing the target. Furthermore, to facilitate dynamic adaptation of the prompt to the target's movements, we propose an online prompt updater. Extensive experiments on five benchmark datasets demonstrate the effectiveness of our proposed method, which also achieves state-of-the-art performance.
Code (0)
등록된 구현이 없습니다.
Tasks
Visual TrackingMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Leveraging Text-to-Image Diffusion Models for Unsupervised Visual Object Tracking
Unsupervised visual object tracking is a challenging task that requires following arbitrary targets in videos without training on ground-truth annotations. Despite considerable progress, existing state-of-the-art unsuper…
Visual Object TrackingImage GenerationDiff-MM: Exploring Pre-trained Text-to-Image Generation Model for Unified Multi-modal Object Tracking
Multi-modal object tracking integrates auxiliary modalities such as depth, thermal infrared, event flow, and language to provide additional information beyond RGB images, showing great potential in improving tracking sta…
Image GenerationObject TrackingText to Image GenerationText-to-Image GenerationDiffusionTrack: Point Set Diffusion Model for Visual Object Tracking
Existing Siamese or transformer trackers commonly pose visual object tracking as a one-shot detection problem i.e. locating the target object in a single forward evaluation scheme. Despite the demonstrated success th…
DenoisingObject TrackingVisual Object TrackingVisual TrackingLearning to Track Objects from Unlabeled Videos
In this paper, we propose to learn an Unsupervised Single Object Tracker (USOT) from scratch. We identify that three major challenges, i.e., moving object discovery, rich temporal variation exploitation, and online updat…
Object DiscoveryOptical Flow EstimationSupervised and Unsupervised Detections for Multiple Object Tracking in Traffic Scenes: A Comparative Study
In this paper, we propose a multiple object tracker, called MF-Tracker, that integrates multiple classical features (spatial distances and colours) and modern features (detection labels and re-identification features) in…
Multiple Object TrackingObjectObject Tracking