paper-with-me

홈 › Papers

DiffMOT: A Real-time Diffusion-based Multiple Object Tracker with Non-linear Prediction

2024-03-04 · CVPR 2024 1 · Weiyi Lv, Yuhang Huang, Ning Zhang, Ruei-Sung Lin, Mei Han, Dan Zeng

In Multiple Object Tracking, objects often exhibit non-linear motion of acceleration and deceleration, with irregular direction changes. Tacking-by-detection (TBD) trackers with Kalman Filter motion prediction work well in pedestrian-dominant scenarios but fall short in complex situations when multiple objects perform non-linear and diverse motion simultaneously. To tackle the complex non-linear motion, we propose a real-time diffusion-based MOT approach named DiffMOT. Specifically, for the motion predictor component, we propose a novel Decoupled Diffusion-based Motion Predictor (D$^2$MP). It models the entire distribution of various motion presented by the data as a whole. It also predicts an individual object's motion conditioning on an individual's historical motion information. Furthermore, it optimizes the diffusion process with much fewer sampling steps. As a MOT tracker, the DiffMOT is real-time at 22.7FPS, and also outperforms the state-of-the-art on DanceTrack and SportsMOT datasets with $62.3\%$ and $76.2\%$ in HOTA metrics, respectively. To the best of our knowledge, DiffMOT is the first to introduce a diffusion probabilistic model into the MOT to tackle non-linear motion prediction.

📄 PDF Abstract BibTeX arXiv:2403.02075

Code (0)

등록된 구현이 없습니다.

Tasks

motion predictionMultiple Object TrackingObject Tracking

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

DiffMotion: Speech-Driven Gesture Synthesis Using Denoising Diffusion Model

2023-01-24 · Fan Zhang, Naye Ji, Fuxing Gao, Yongping Li

Speech-driven gesture synthesis is a field of growing interest in virtual human creation. However, a critical challenge is the inherent intricate one-to-many mapping between speech and gestures. Previous studies have exp…

Denoising

Speech-driven Personalized Gesture Synthetics: Harnessing Automatic Fuzzy Feature Inference

2024-03-16 · Fan Zhang, Zhaohan Wang, Xin Lyu, Siyuan Zhao 외

Speech-driven gesture generation is an emerging field within virtual human creation. However, a significant challenge lies in accurately determining and processing the multitude of input features (such as acoustic, seman…

Gesture Generation

Hallucination Early Detection in Diffusion Models

2026-04-22 · Federico Betti, Lorenzo Baraldi, Lorenzo Baraldi, Rita Cucchiara 외 arxiv

Text-to-Image generation has seen significant advancements in output realism with the advent of diffusion models. However, diffusion models encounter difficulties when tasked with generating multiple objects, frequently …

Text-to-Image Generation

Step-level Denoising-time Diffusion Alignment with Multiple Objectives

2026-04-15 · Qi Zhang, Dawei Wang, Shaofeng Zou arxiv

Reinforcement learning (RL) has emerged as a powerful tool for aligning diffusion models with human preferences, typically by optimizing a single reward function under a KL regularization constraint. In practice, however…

Reinforcement Learning

ObjectComposer: Consistent Generation of Multiple Objects Without Fine-tuning

2023-10-10 · Alec Helbling, Evan Montoya, Duen Horng Chau

Recent text-to-image generative models can generate high-fidelity images from text prompts. However, these models struggle to consistently generate the same objects in different contexts with the same appearance. Consist…