paper-with-me

Papers

Continuous-Time Functional Diffusion Processes

2023-03-01 · NeurIPS 2023 11 · Giulio Franzese, Giulio Corallo, Simone Rossi, Markus Heinonen, Maurizio Filippone, Pietro Michiardi

We introduce Functional Diffusion Processes (FDPs), which generalize score-based diffusion models to infinite-dimensional function spaces. FDPs require a new mathematical framework to describe the forward and backward dynamics, and several extensions to derive practical training objectives. These include infinite-dimensional versions of Girsanov theorem, in order to be able to compute an ELBO, and of the sampling theorem, in order to guarantee that functional evaluations in a countable set of points are equivalent to infinite-dimensional functions. We use FDPs to build a new breed of generative models in function spaces, which do not require specialized network architectures, and that can work with any kind of continuous data. Our results on real data show that FDPs achieve high-quality image generation, using a simple MLP architecture with orders of magnitude fewer parameters than existing diffusion models.

📄 PDF Abstract BibTeX arXiv:2303.00800

Code (1)

giulio98/functional-diffusion-processes 공식 구현 jax

Tasks

Image Generation

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

Concentration analysis of multivariate elliptic diffusion processes

2022-06-07 · Cathrine Aeckerle-Willems, Claudia Strauch, Lukas Trottner

We prove concentration inequalities and associated PAC bounds for continuous- and discrete-time additive functionals for possibly unbounded functions of multivariate, nonreversible diffusion processes. Our analysis relie…

A Continuous-time Stochastic Gradient Descent Method for Continuous Data

2021-12-07 · Kexin Jin, Jonas Latz, ChenGuang Liu, Carola-Bibiane Schönlieb

Optimization problems with continuous data appear in, e.g., robust machine learning, functional data analysis, and variational inference. Here, the target function is given as an integral over a family of (continuously) …

Stochastic OptimizationVariational Inference

Affine Jump-Diffusions: Stochastic Stability and Limit Theorems

2018-10-31

Affine jump-diffusions constitute a large class of continuous-time stochastic models that are particularly popular in finance and economics due to their analytical tractability. Methods for parameter estimation for such …

parameter estimation

Functional Diffusion Maps

2023-04-27 · María Barroso, Carlos María Alaíz, Ángela Fernández, Jose Luis Torrecilla

Nowadays many real-world datasets can be considered as functional, in the sense that the processes which generate them are continuous. A fundamental property of this type of data is that in theory they belong to an infin…

Dimensionality Reduction

Approximate inference with Wasserstein gradient flows

2018-06-12 · Charlie Frogner, Tomaso Poggio

We present a novel approximate inference method for diffusion processes, based on the Wasserstein gradient flow formulation of the diffusion. In this formulation, the time-dependent density of the diffusion is derived as…