paper-with-me

Papers

CFG-Ctrl: Control-Based Classifier-Free Diffusion Guidance

2026-03-03 · Hanyang Wang, Yiyang Liu, Jiawei Chi, Fangfu Liu, Ran Xue, Yueqi Duan arxiv

Classifier-Free Guidance (CFG) has emerged as a central approach for enhancing semantic alignment in flow-based diffusion models. In this paper, we explore a unified framework called CFG-Ctrl, which reinterprets CFG as a control applied to the first-order continuous-time generative flow, using the conditional-unconditional discrepancy as an error signal to adjust the velocity field. From this perspective, we summarize vanilla CFG as a proportional controller (P-control) with fixed gain, and typical follow-up variants develop extended control-law designs derived from it. However, existing methods mainly rely on linear control, inherently leading to instability, overshooting, and degraded semantic fidelity especially on large guidance scales. To address this, we introduce Sliding Mode Control CFG (SMC-CFG), which enforces the generative flow toward a rapidly convergent sliding manifold. Specifically, we define an exponential sliding mode surface over the semantic prediction error and introduce a switching control term to establish nonlinear feedback-guided correction. Moreover, we provide a Lyapunov stability analysis to theoretically support finite-time convergence. Experiments across text-to-image generation models including Stable Diffusion 3.5, Flux, and Qwen-Image demonstrate that SMC-CFG outperforms standard CFG in semantic alignment and enhances robustness across a wide range of guidance scales. Project Page: https://hanyang-21.github.io/CFG-Ctrl

📄 PDF Abstract BibTeX arXiv:2603.03281

Code (0)

등록된 구현이 없습니다.

Tasks

Text-to-Image Generation

Similar Papers 제목 키워드 기반

Ctrl-X: Controlling Structure and Appearance for Text-To-Image Generation Without Guidance

2024-06-11 · Kuan Heng Lin, Sicheng Mo, Ben Klingher, Fangzhou Mu 외

Recent controllable generation approaches such as FreeControl and Diffusion Self-Guidance bring fine-grained spatial and appearance control to text-to-image (T2I) diffusion models without training auxiliary modules. Howe…

Appearance TransferImage GenerationText to Image GenerationText-to-Image Generation

Ctrl-Crash: Controllable Diffusion for Realistic Car Crashes

2025-05-30 · Anthony Gosselin, Ge Ya Luo, Luis Lara, Florian Golemo 외

Video diffusion techniques have advanced significantly in recent years; however, they struggle to generate realistic imagery of car crashes due to the scarcity of accident events in most driving datasets. Improving traff…

counterfactualVideo Generation

Adding Conditional Control to Diffusion Models with Reinforcement Learning

2024-06-17 · Yulai Zhao, Masatoshi Uehara, Gabriele Scalia, Tommaso Biancalani 외

Diffusion models are powerful generative models that allow for precise control over the characteristics of the generated samples. While these diffusion models trained on large datasets have achieved success, there is oft…

reinforcement-learningReinforcement LearningReinforcement Learning (RL)

TextCtrl: Diffusion-based Scene Text Editing with Prior Guidance Control

2024-10-14 · Weichao Zeng, Yan Shu, Zhenhang Li, Dongbao Yang 외

Centred on content modification and style preservation, Scene Text Editing (STE) remains a challenging task despite considerable progress in text-to-image synthesis and text-driven image manipulation recently. GAN-based …

DisentanglementImage GenerationImage ManipulationScene Text Editing

C$^2$FG: Control Classifier-Free Guidance via Score Discrepancy Analysis

2026-03-09 · Jiayang Gao, Tianyi Zheng, Jiayang Zou, Fengxiang Yang 외 arxiv

Classifier-Free Guidance (CFG) is a cornerstone of modern conditional diffusion models, yet its reliance on the fixed or heuristic dynamic guidance weight is predominantly empirical and overlooks the inherent dynamics of…