paper-with-me

홈 › Papers

Diffusion Sampling Path Tells More: An Efficient Plug-and-Play Strategy for Sample Filtering

2025-05-29 · Sixian Wang, Zhiwei Tang, Tsung-Hui Chang

Diffusion models often exhibit inconsistent sample quality due to stochastic variations inherent in their sampling trajectories. Although training-based fine-tuning (e.g. DDPO [1]) and inference-time alignment techniques[2] aim to improve sample fidelity, they typically necessitate full denoising processes and external reward signals. This incurs substantial computational costs, hindering their broader applicability. In this work, we unveil an intriguing phenomenon: a previously unobserved yet exploitable link between sample quality and characteristics of the denoising trajectory during classifier-free guidance (CFG). Specifically, we identify a strong correlation between high-density regions of the sample distribution and the Accumulated Score Differences (ASD)--the cumulative divergence between conditional and unconditional scores. Leveraging this insight, we introduce CFG-Rejection, an efficient, plug-and-play strategy that filters low-quality samples at an early stage of the denoising process, crucially without requiring external reward signals or model retraining. Importantly, our approach necessitates no modifications to model architectures or sampling schedules and maintains full compatibility with existing diffusion frameworks. We validate the effectiveness of CFG-Rejection in image generation through extensive experiments, demonstrating marked improvements on human preference scores (HPSv2, PickScore) and challenging benchmarks (GenEval, DPG-Bench). We anticipate that CFG-Rejection will offer significant advantages for diverse generative modalities beyond images, paving the way for more efficient and reliable high-quality sample generation.

📄 PDF Abstract BibTeX arXiv:2505.23343

Code (1)

wsx20003/cfg-rejection 공식 구현 pytorch

Tasks

DenoisingImage Generation

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

Zigzag Diffusion Sampling: Diffusion Models Can Self-Improve via Self-Reflection

2024-12-14 · Lichen Bai, Shitong Shao, Zikai Zhou, Zipeng Qi 외

Diffusion models, the most popular generative paradigm so far, can inject conditional information into the generation path to guide the latent towards desired directions. However, existing text-to-image diffusion models …

Denoising

HiGS: History-Guided Sampling for Plug-and-Play Enhancement of Diffusion Models

2025-09-26 · Seyedmorteza Sadat, Farnood Salehi, Romann M. Weber arxiv

While diffusion models have made remarkable progress in image generation, their outputs can still appear unrealistic and lack fine details, especially when using fewer number of neural function evaluations (NFEs) or lowe…

Image Generation

NFCDS: A Plug-and-Play Noise Frequency-Controlled Diffusion Sampling Strategy for Image Restoration

2026-01-29 · Zhen Wang, Hongyi Liu, Jianing Li, Zhihui Wei arxiv

Diffusion sampling-based Plug-and-Play (PnP) methods produce images with high perceptual quality but often suffer from reduced data fidelity, primarily due to the noise introduced during reverse diffusion. To address thi…

Image Restoration

A Plug-in Interpretation of Conditioning in Score-Based Diffusion Models

2026-08-19 · Libo Chen, Souvik Ghosh, Teo Deveney, Chris Budd 외 arxiv

We propose a conditioning mechanism for diffusion models based on multi-speed joint diffusion of the target and the condition. The mechanism learns an unconditional joint score network and enforces conditioning at infere…

Conditional Image Generation

Plug-and-play Diffusion Models for Image Compressive Sensing with Data Consistency Projection

2025-09-11 · Xiaodong Wang, Ping Wang, Zhangyuan Li, Xin Yuan arxiv

We explore the connection between Plug-and-Play (PnP) methods and Denoising Diffusion Implicit Models (DDIM) for solving ill-posed inverse problems, with a focus on single-pixel imaging. We begin by identifying key disti…

Compressive Sensing