paper-with-me

Papers

Categorical Flow Maps

2026-02-12 · Daan Roos, Oscar Davis, Floor Eijkelboom, Michael Bronstein, Max Welling, İsmail İlkan Ceylan, Luca Ambrogioni, Jan-Willem van de Meent arxiv

We introduce Categorical Flow Maps, a flow-matching method for accelerated few-step generation of categorical data via self-distillation. Building on recent variational formulations of flow matching and the broader trend towards accelerated inference in diffusion and flow-based models, we define a flow map towards the simplex that transports probability mass toward a predicted endpoint, yielding a parametrisation that naturally constrains model predictions. Since our trajectories are continuous rather than discrete, Categorical Flow Maps can be trained with existing distillation techniques, as well as a new objective based on endpoint consistency. This continuous formulation also automatically unlocks test-time inference: we can directly reuse existing guidance and reweighting techniques in the categorical setting to steer sampling toward downstream objectives. Empirically, we achieve state-of-the-art few-step results on images, molecular graphs, and text, with strong performance even in single-step generation.

📄 PDF Abstract BibTeX arXiv:2602.12233

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Argmax Flows and Multinomial Diffusion: Learning Categorical Distributions

2021-02-10 · NeurIPS 2021 12 · Emiel Hoogeboom, Didrik Nielsen, Priyank Jaini, Patrick Forré 외

Generative flows and diffusion models have been predominantly trained on ordinal data, for example natural images. This paper introduces two extensions of flows and diffusion for categorical data such as language or imag…

DenoisingImage SegmentationLanguage ModellingSegmentation+1

Scaling Categorical Flow Maps

2026-05-08 · Oscar Davis, Anastasiia Filippova, Pierre Ablin, Victor Turrisi 외 arxiv

Continuous diffusion and flow matching models could represent a powerful alternative to autoregressive approaches for language modelling (LM), as they unlock a host of advantages currently reserved for continuous modalit…

Language Modelling

Discrete Denoising Flows

2021-07-24 · ICML Workshop INNF 2021 7 · Alexandra Lindt, Emiel Hoogeboom

Discrete flow-based models are a recently proposed class of generative models that learn invertible transformations for discrete random variables. Since they do not require data dequantization and maximize an exact likel…

Denoising

Categorical Normalizing Flows via Continuous Transformations

2020-06-17 · ICLR 2021 1 · Phillip Lippe, Efstratios Gavves

Despite their popularity, to date, the application of normalizing flows on categorical data stays limited. The current practice of using dequantization to map discrete data to a continuous space is inapplicable as catego…

DecoderInductive BiasVariational Inference

Simplex-to-Euclidean Bijections for Categorical Flow Matching

2025-10-31 · Bernardo Williams, Victor M. Yeom-Song, Marcelo Hartmann, Arto Klami arxiv

We propose a method for learning and sampling from probability distributions supported on the simplex. Our approach maps the open simplex to Euclidean space via smooth bijections, leveraging the Aitchison geometry to def…