paper-with-me

홈 › Papers

TFG: Unified Training-Free Guidance for Diffusion Models

2024-09-24 · Haotian Ye, Haowei Lin, Jiaqi Han, Minkai Xu, Sheng Liu, Yitao Liang, Jianzhu Ma, James Zou, Stefano Ermon

Given an unconditional diffusion model and a predictor for a target property of interest (e.g., a classifier), the goal of training-free guidance is to generate samples with desirable target properties without additional training. Existing methods, though effective in various individual applications, often lack theoretical grounding and rigorous testing on extensive benchmarks. As a result, they could even fail on simple tasks, and applying them to a new problem becomes unavoidably difficult. This paper introduces a novel algorithmic framework encompassing existing methods as special cases, unifying the study of training-free guidance into the analysis of an algorithm-agnostic design space. Via theoretical and empirical investigation, we propose an efficient and effective hyper-parameter searching strategy that can be readily applied to any downstream task. We systematically benchmark across 7 diffusion models on 16 tasks with 40 targets, and improve performance by 8.5% on average. Our framework and benchmark offer a solid foundation for conditional generation in a training-free manner.

📄 PDF Abstract BibTeX arXiv:2409.15761

Code (1)

YWolfeee/Training-Free-Guidance 공식 구현 pytorch

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

Training-Free Guidance Beyond Differentiability: Scalable Path Steering with Tree Search in Diffusion and Flow Models

2025-02-17 · Yingqing Guo, Yukang Yang, Hui Yuan, Mengdi Wang

Training-free guidance enables controlled generation in diffusion and flow models, but most existing methods assume differentiable objectives and rely on gradients. This work focuses on training-free guidance addressing …

Music Generation

More Control for Free! Image Synthesis with Semantic Diffusion Guidance

2021-12-10 · Xihui Liu, Dong Huk Park, Samaneh Azadi, Gong Zhang 외

Controllable image synthesis models allow creation of diverse images based on text instructions or guidance from a reference image. Recently, denoising diffusion probabilistic models have been shown to generate more real…

continuous-controlContinuous ControlDenoisingImage Generation

Test-Time Anchoring for Discrete Diffusion Posterior Sampling

2025-10-02 · Litu Rout, Andreas Lugmayr, Yasamin Jafarian, Srivatsan Varadharajan 외 arxiv

While continuous diffusion models have achieved remarkable success, discrete diffusion offers a unified framework for jointly modeling text and images. Beyond unification, discrete diffusion provides faster inference, fi…

Question Answering

Training-Free Multimodal Guidance for Video to Audio Generation

2025-09-29 · Eleonora Grassucci, Giuliano Galadini, Giordano Cicchetti, Aurelio Uncini 외 arxiv

Video-to-audio (V2A) generation aims to synthesize realistic and semantically aligned audio from silent videos, with potential applications in video editing, Foley sound design, and assistive multimedia. Although the exc…

Audio Generation

NEGATE: Constrained Semantic Guidance for Linguistic Negation in Text-to-Video Diffusion

2026-03-06 · Taewon Kang, Ming C. Lin arxiv

Negation is a fundamental linguistic operator, yet it remains inadequately modeled in diffusion-based generative systems. In this work, we present a formal treatment of linguistic negation in diffusion-based generative m…

Image Generation