paper-with-me

홈 › Papers

Diff-Tracker: Text-to-Image Diffusion Models are Unsupervised Trackers

2024-07-11 · Zhengbo Zhang, Li Xu, Duo Peng, Hossein Rahmani, Jun Liu

We introduce Diff-Tracker, a novel approach for the challenging unsupervised visual tracking task leveraging the pre-trained text-to-image diffusion model. Our main idea is to leverage the rich knowledge encapsulated within the pre-trained diffusion model, such as the understanding of image semantics and structural information, to address unsupervised visual tracking. To this end, we design an initial prompt learner to enable the diffusion model to recognize the tracking target by learning a prompt representing the target. Furthermore, to facilitate dynamic adaptation of the prompt to the target's movements, we propose an online prompt updater. Extensive experiments on five benchmark datasets demonstrate the effectiveness of our proposed method, which also achieves state-of-the-art performance.

📄 PDF Abstract BibTeX arXiv:2407.08394

Code (0)

등록된 구현이 없습니다.

Tasks

Visual Tracking

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

Leveraging Text-to-Image Diffusion Models for Unsupervised Visual Object Tracking

2026-05-26 · Zhengbo Zhang, Zhigang Tu, Junsong Yuan, De Wen Soh 외 arxiv

Unsupervised visual object tracking is a challenging task that requires following arbitrary targets in videos without training on ground-truth annotations. Despite considerable progress, existing state-of-the-art unsuper…

Visual Object TrackingImage Generation

Diff-MM: Exploring Pre-trained Text-to-Image Generation Model for Unified Multi-modal Object Tracking

2025-05-19 · Shiyu Xuan, Zechao Li, Jinhui Tang

Multi-modal object tracking integrates auxiliary modalities such as depth, thermal infrared, event flow, and language to provide additional information beyond RGB images, showing great potential in improving tracking sta…

Image GenerationObject TrackingText to Image GenerationText-to-Image Generation

DiffusionTrack: Point Set Diffusion Model for Visual Object Tracking

2024-01-01 · CVPR 2024 1 · Fei Xie, Zhongdao Wang, Chao Ma

Existing Siamese or transformer trackers commonly pose visual object tracking as a one-shot detection problem i.e. locating the target object in a single forward evaluation scheme. Despite the demonstrated success th…

DenoisingObject TrackingVisual Object TrackingVisual Tracking

Learning to Track Objects from Unlabeled Videos

2021-08-28 · ICCV 2021 10 · Jilai Zheng, Chao Ma, Houwen Peng, Xiaokang Yang

In this paper, we propose to learn an Unsupervised Single Object Tracker (USOT) from scratch. We identify that three major challenges, i.e., moving object discovery, rich temporal variation exploitation, and online updat…

Object DiscoveryOptical Flow Estimation

Supervised and Unsupervised Detections for Multiple Object Tracking in Traffic Scenes: A Comparative Study

2020-03-30 · Hui-Lee Ooi, Guillaume-Alexandre Bilodeau, Nicolas Saunier

In this paper, we propose a multiple object tracker, called MF-Tracker, that integrates multiple classical features (spatial distances and colours) and modern features (detection labels and re-identification features) in…

Multiple Object TrackingObjectObject Tracking