paper-with-me

홈 › Papers

Infinite-Dimensional Diffusion Models

2023-02-20 · Jakiw Pidstrigach, Youssef Marzouk, Sebastian Reich, Sven Wang

Diffusion models have had a profound impact on many application areas, including those where data are intrinsically infinite-dimensional, such as images or time series. The standard approach is first to discretize and then to apply diffusion models to the discretized data. While such approaches are practically appealing, the performance of the resulting algorithms typically deteriorates as discretization parameters are refined. In this paper, we instead directly formulate diffusion-based generative models in infinite dimensions and apply them to the generative modelling of functions. We prove that our formulations are well posed in the infinite-dimensional setting and provide dimension-independent distance bounds from the sample to the target measure. Using our theory, we also develop guidelines for the design of infinite-dimensional diffusion models. For image distributions, these guidelines are in line with current canonical choices. For other distributions, however, we can improve upon these canonical choices. We demonstrate these results both theoretically and empirically, by applying the algorithms to data distributions on manifolds and to distributions arising in Bayesian inverse problems or simulation-based inference.

📄 PDF Abstract BibTeX arXiv:2302.10130

Code (0)

등록된 구현이 없습니다.

Tasks

Time Series

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

Stochastic Optimal Control for Diffusion Bridges in Function Spaces

2024-05-31 · Byoungwoo Park, JungWon Choi, Sungbin Lim, Juho Lee

Recent advancements in diffusion models and diffusion bridges primarily focus on finite-dimensional spaces, yet many real-world problems necessitate operations in infinite-dimensional function spaces for more natural and…

Image-to-Image TranslationTime Series

Multilevel Diffusion: Infinite Dimensional Score-Based Diffusion Models for Image Generation

2023-03-08 · Paul Hagemann, Sophie Mildenberger, Lars Ruthotto, Gabriele Steidl 외

Score-based diffusion models (SBDM) have recently emerged as state-of-the-art approaches for image generation. Existing SBDMs are typically formulated in a finite-dimensional setting, where images are considered as tenso…

Image Generation

Infinite-dimensional Diffusion Bridge Simulation via Operator Learning

2024-05-28 · Gefan Yang, Elizabeth Louise Baker, Michael L. Severinsen, Christy Anna Hipsley 외

The diffusion bridge, which is a diffusion process conditioned on hitting a specific state within a finite period, has found broad applications in various scientific and engineering fields. However, simulating diffusion …

Bayesian InferenceOperator learning

Functional Adjoint Sampler: Scalable Sampling on Infinite Dimensional Spaces

2025-11-09 · Byoungwoo Park, Juho Lee, Guan-Horng Liu arxiv

Learning-based methods for sampling from the Gibbs distribution in finite-dimensional spaces have progressed quickly, yet theory and algorithmic design for infinite-dimensional function spaces remain limited. This gap pe…

Continuous-Time Functional Diffusion Processes

2023-03-01 · NeurIPS 2023 11 · Giulio Franzese, Giulio Corallo, Simone Rossi, Markus Heinonen 외

We introduce Functional Diffusion Processes (FDPs), which generalize score-based diffusion models to infinite-dimensional function spaces. FDPs require a new mathematical framework to describe the forward and backward dy…

Image Generation