paper-with-me

Papers

DiffusionTrack: Point Set Diffusion Model for Visual Object Tracking

2024-01-01 · CVPR 2024 1 · Fei Xie, Zhongdao Wang, Chao Ma

Existing Siamese or transformer trackers commonly pose visual object tracking as a one-shot detection problem i.e. locating the target object in a single forward evaluation scheme. Despite the demonstrated success these trackers may easily drift towards distractors with similar appearance due to the single forward evaluation scheme lacking self-correction. To address this issue we cast visual tracking as a point set based denoising diffusion process and propose a novel generative learning based tracker dubbed DiffusionTrack. Our DiffusionTrack possesses two appealing properties: 1) It follows a novel noise-to-target tracking paradigm that leverages multiple denoising diffusion steps to localize the target in a dynamic searching manner per frame. 2) It models the diffusion process using a point set representation which can better handle appearance variations for more precise localization. One side benefit is that DiffusionTrack greatly simplifies the post-processing e.g. removing window penalty scheme. Without bells and whistles our DiffusionTrack achieves leading performance over the state-of-the-art trackers and runs in real-time. The code is in https://github.com/VISION-SJTU/DiffusionTrack.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

DenoisingObject TrackingVisual Object TrackingVisual Tracking

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically
Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

DiffusionTrack: Diffusion Model For Multi-Object Tracking

2023-08-19 · Run Luo, Zikai Song, Lintao Ma, JinLin Wei 외

Multi-object tracking (MOT) is a challenging vision task that aims to detect individual objects within a single frame and associate them across multiple frames. Recent MOT approaches can be categorized into two-stage tra…

DenoisingmodelMulti-Object TrackingObject+3

ConsistencyTrack: A Robust Multi-Object Tracker with a Generation Strategy of Consistency Model

2024-08-28 · Lifan Jiang, Zhihui Wang, Siqi Yin, Guangxiao Ma 외

Multi-object tracking (MOT) is a critical technology in computer vision, designed to detect multiple targets in video sequences and assign each target a unique ID per frame. Existed MOT methods excel at accurately tracki…

DenoisingMulti-Object TrackingObject Tracking

Video Diffusion Models Excel at Tracking Similar-Looking Objects Without Supervision

2025-12-02 · Chenshuang Zhang, Kang Zhang, Joon Son Chung, In So Kweon 외 arxiv

Distinguishing visually similar objects by their motion remains a critical challenge in computer vision. Although supervised trackers show promise, contemporary self-supervised trackers struggle when visual cues become a…

Track4Gen: Teaching Video Diffusion Models to Track Points Improves Video Generation

2024-12-08 · CVPR 2025 1 · Hyeonho Jeong, Chun-Hao Paul Huang, Jong Chul Ye, Niloy Mitra 외

While recent foundational video generators produce visually rich output, they still struggle with appearance drift, where objects gradually degrade or change inconsistently across frames, breaking visual coherence. We hy…

Point TrackingVideo Generation

Probing and Leveraging Video Diffusion Transformer Features for Robust Point Tracking

2025-12-23 · Soowon Son, Honggyu An, Jisu Nam, Hyunah Ko 외 arxiv

Despite achieving strong results on standard benchmarks, current point tracking methods rely on feature backbones that are rarely designed with the temporal coherence needed for robust real-world performance. While recen…

Point Tracking