PSDiff: Diffusion Model for Person Search with Iterative and Collaborative Refinement
Dominant Person Search methods aim to localize and recognize query persons in a unified network, which jointly optimizes two sub-tasks, \ie, pedestrian detection and Re-IDentification (ReID). Despite significant progress, current methods face two primary challenges: 1) the pedestrian candidates learned within detectors are suboptimal for the ReID task. 2) the potential for collaboration between two sub-tasks is overlooked. To address these issues, we present a novel Person Search framework based on the Diffusion model, PSDiff. PSDiff formulates the person search as a dual denoising process from noisy boxes and ReID embeddings to ground truths. Distinct from the conventional Detection-to-ReID approach, our denoising paradigm discards prior pedestrian candidates generated by detectors, thereby avoiding the local optimum problem of the ReID task. Following the new paradigm, we further design a new Collaborative Denoising Layer (CDL) to optimize detection and ReID sub-tasks in an iterative and collaborative way, which makes two sub-tasks mutually beneficial. Extensive experiments on the standard benchmarks show that PSDiff achieves state-of-the-art performance with fewer parameters and elastic computing overhead.
Code (0)
등록된 구현이 없습니다.
Tasks
DenoisingPedestrian DetectionPerson SearchTask 2Methods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
PSDiffusion: Harmonized Multi-Layer Image Generation via Layout and Appearance Alignment
Diffusion models have made remarkable advancements in generating high-quality images from textual descriptions. Recent works like LayerDiffuse have extended the previous single-layer, unified image generation paradigm to…
Image GenerationText to Image GenerationText-to-Image GenerationGraph Signal Diffusion Model for Collaborative Filtering
Collaborative filtering is a critical technique in recommender systems. It has been increasingly viewed as a conditional generative task for user feedback data, where newly developed diffusion model shows great potential…
Collaborative FilteringDenoisingmodelRecommendation SystemsCollaborative Diffusion Model for Recommender System
Diffusion-based recommender systems (DR) have gained increasing attention for their advanced generative and denoising capabilities. However, existing DR face two central limitations: (i) a trade-off between enhancing gen…
DenoisingmodelRecommendation SystemsPersonalized Image Editing in Text-to-Image Diffusion Models via Collaborative Direct Preference Optimization
Text-to-image (T2I) diffusion models have made remarkable strides in generating and editing high-fidelity images from text. Yet, these models remain fundamentally generic, failing to adapt to the nuanced aesthetic prefer…
Graph Neural NetworkImage EditingMindTailor: Personalized Emotional Support via Post History-Grounded Case Formulation and Collaborative Refinement
As mental health concerns continue to rise globally, social media has emerged as a vital space where individuals seek emotional support. While prior work on personalized emotional support has leveraged seekers' emotional…