paper-with-me

홈 › Papers

Diff2Flow: Training Flow Matching Models via Diffusion Model Alignment

2025-01-01 · CVPR 2025 1 · Johannes Schusterbauer, Ming Gui, Frank Fundel, Björn Ommer

Diffusion models have revolutionized generative tasks through high-fidelity outputs, yet flow matching (FM) offers faster inference and empirical performance gains. However, current foundation FM models are computationally prohibitive for finetuning, while diffusion models like Stable Diffusion benefit from efficient architectures and ecosystem support. This work addresses the critical challenge of efficiently transferring knowledge from pre-trained diffusion models to flow matching. We propose Diff2Flow, a novel framework that systematically bridges diffusion and FM paradigms by rescaling timesteps, aligning interpolants, and deriving FM-compatible velocity fields from diffusion predictions. This alignment enables direct and efficient FM finetuning of diffusion priors with no extra computation overhead. Our experiments demonstrate that Diff2Flow outperforms naive FM and diffusion finetuning particularly under parameter-efficient constraints, while achieving superior or competitive performance across diverse downstream tasks compared to state-of-the-art methods.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

Flow Matching for Generative Modeling

2022-10-06 · Yaron Lipman, Ricky T. Q. Chen, Heli Ben-Hamu, Maximilian Nickel 외

We introduce a new paradigm for generative modeling built on Continuous Normalizing Flows (CNFs), allowing us to train CNFs at unprecedented scale. Specifically, we present the notion of Flow Matching (FM), a simulation-…

Density EstimationImage Generation

FlowLM: Few-Step Language Modeling via Diffusion-to-Flow Adaptation

2026-04-06 · Runzhe Zhang, Letian Chen, Wenpeng Zhang, Zhouhan Lin 외 arxiv

We present FlowLM, a flow matching language model transformed from pre-trained diffusion language models via efficient fine-tuning. By re-aligning the curved sampling trajectories of diffusion models into straight-line f…

Text Generation

Interpreting diffusion score matching using normalizing flow

2021-07-21 · ICML Workshop INNF 2021 7 · Wenbo Gong, Yingzhen Li

Scoring matching (SM), and its related counterpart, Stein discrepancy (SD) have achieved great success in model training and evaluations. However, recent research shows their limitations when dealing with certain types o…

Rectified Diffusion: Straightness Is Not Your Need in Rectified Flow

2024-10-09 · Fu-Yun Wang, Ling Yang, Zhaoyang Huang, Mengdi Wang 외

Diffusion models have greatly improved visual generation but are hindered by slow generation speed due to the computationally intensive nature of solving generative ODEs. Rectified flow, a widely recognized solution, imp…

Exploring Diffusion and Flow Matching Under Generator Matching

2024-12-15 · Zeeshan Patel, James DeLoye, Lance Mathias

In this paper, we present a comprehensive theoretical comparison of diffusion and flow matching under the Generator Matching framework. Despite their apparent differences, both diffusion and flow matching can be viewed u…