paper-with-me

Papers

Flow map matching with stochastic interpolants: A mathematical framework for consistency models

2024-06-11 · Nicholas M. Boffi, Michael S. Albergo, Eric Vanden-Eijnden

Generative models based on dynamical equations such as flows and diffusions offer exceptional sample quality, but require computationally expensive numerical integration during inference. The advent of consistency models has enabled efficient one-step or few-step generation, yet despite their practical success, a systematic understanding of their design has been hindered by the lack of a comprehensive theoretical framework. Here we introduce Flow Map Matching (FMM), a principled framework for learning the two-time flow map of an underlying dynamical generative model, thereby providing this missing mathematical foundation. Leveraging stochastic interpolants, we propose training objectives both for distillation from a pre-trained velocity field and for direct training of a flow map over an interpolant or a forward diffusion process. Theoretically, we show that FMM unifies and extends a broad class of existing approaches for fast sampling, including consistency models, consistency trajectory models, and progressive distillation. Experiments on CIFAR-10 and ImageNet-32 highlight that our approach can achieve sample quality comparable to flow matching while reducing generation time by a factor of 10-20.

📄 PDF Abstract BibTeX arXiv:2406.07507

Code (0)

등록된 구현이 없습니다.

Tasks

Numerical Integration

Methods 이 논문이 사용한 방법론

BASE 설명 없음
Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

SplineFlow: Flow Matching for Dynamical Systems with B-Spline Interpolants

2026-01-30 · Santanu Subhash Rathod, Pietro Liò, Xiao Zhang arxiv

Flow matching is a scalable generative framework for characterizing continuous normalizing flows with wide-range applications. However, current state-of-the-art methods are not well-suited for modeling dynamical systems,…

Open Materials Generation with Stochastic Interpolants

2025-02-04 · Philipp Hoellmer, Thomas Egg, Maya M. Martirossyan, Eric Fuemmeler 외

The discovery of new materials is essential for enabling technological advancements. Computational approaches for predicting novel materials must effectively learn the manifold of stable crystal structures within an infi…

Stochastic Interpolants: A Unifying Framework for Flows and Diffusions

2023-03-15 · Michael S. Albergo, Nicholas M. Boffi, Eric Vanden-Eijnden

A class of generative models that unifies flow-based and diffusion-based methods is introduced. These models extend the framework proposed in Albergo & Vanden-Eijnden (2023), enabling the use of a broad class of continuo…

Denoising

Tilt Matching for Scalable Sampling and Fine-Tuning

2025-12-26 · Peter Potaptchik, Cheuk-Kit Lee, Michael S. Albergo arxiv

We propose a simple, scalable algorithm for using stochastic interpolants to sample from unnormalized densities and for fine-tuning generative models. The approach, Tilt Matching, arises from a dynamical equation relatin…

Multi-Marginal Flow Matching with Adversarially Learnt Interpolants

2025-10-01 · Oskar Kviman, Kirill Tamogashev, Nicola Branchini, Víctor Elvira 외 arxiv

Learning the dynamics of a process given sampled observations at several time points is an important but difficult task in many scientific applications. When no ground-truth trajectories are available, but one has only s…

Trajectory Prediction