paper-with-me

홈 › Papers

RectifID: Personalizing Rectified Flow with Anchored Classifier Guidance

2024-05-23 · Zhicheng Sun, Zhenhao Yang, Yang Jin, Haozhe Chi, Kun Xu, Liwei Chen, Hao Jiang, Yang song, Kun Gai, Yadong Mu

Customizing diffusion models to generate identity-preserving images from user-provided reference images is an intriguing new problem. The prevalent approaches typically require training on extensive domain-specific images to achieve identity preservation, which lacks flexibility across different use cases. To address this issue, we exploit classifier guidance, a training-free technique that steers diffusion models using an existing classifier, for personalized image generation. Our study shows that based on a recent rectified flow framework, the major limitation of vanilla classifier guidance in requiring a special classifier can be resolved with a simple fixed-point solution, allowing flexible personalization with off-the-shelf image discriminators. Moreover, its solving procedure proves to be stable when anchored to a reference flow trajectory, with a convergence guarantee. The derived method is implemented on rectified flow with different off-the-shelf image discriminators, delivering advantageous personalization results for human faces, live subjects, and certain objects. Code is available at https://github.com/feifeiobama/RectifID.

📄 PDF Abstract BibTeX arXiv:2405.14677

Code (1)

feifeiobama/RectifID 공식 구현 pytorch

Tasks

Image GenerationPersonalized Image Generation

Methods 이 논문이 사용한 방법론

classifier-guidance 설명 없음
Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

FlashAudio: Rectified Flows for Fast and High-Fidelity Text-to-Audio Generation

2024-10-16 · Huadai Liu, Jialei Wang, Rongjie Huang, Yang Liu 외

Recent advancements in latent diffusion models (LDMs) have markedly enhanced text-to-audio generation, yet their iterative sampling processes impose substantial computational demands, limiting practical deployment. While…

Audio GenerationGPU

MusRec: Zero-Shot Text-to-Music Editing via Rectified Flow and Diffusion Transformers

2025-11-06 · Ali Boudaghi, Hadi Zare arxiv

Music editing has emerged as an important and practical area of artificial intelligence, with applications ranging from video game and film music production to personalizing existing tracks according to user preferences.…

Rectified-CFG++ for Flow Based Models

2025-10-09 · Shreshth Saini, Shashank Gupta, Alan C. Bovik arxiv

Classifier-free guidance (CFG) is the workhorse for steering large diffusion models toward text-conditioned targets, yet its native application to rectified flow (RF) based models provokes severe off-manifold drift, yiel…

Steering Rectified Flow Models in the Vector Field for Controlled Image Generation

2024-11-27 · Maitreya Patel, Song Wen, Dimitris N. Metaxas, Yezhou Yang

Diffusion models (DMs) excel in photorealism, image editing, and solving inverse problems, aided by classifier-free guidance and image inversion techniques. However, rectified flow models (RFMs) remain underexplored for …

DenoisingImage GenerationNavigate

Improving the Training of Rectified Flows

2024-05-30 · Sangyun Lee, Zinan Lin, Giulia Fanti

Diffusion models have shown great promise for image and video generation, but sampling from state-of-the-art models requires expensive numerical integration of a generative ODE. One approach for tackling this problem is …

Image GenerationKnowledge DistillationNumerical IntegrationVideo Generation