paper-with-me

Papers

Generative Modeling with Bayesian Sample Inference

2025-02-11 · Marten Lienen, Marcel Kollovieh, Stephan Günnemann

We derive a novel generative model from iterative Gaussian posterior inference. By treating the generated sample as an unknown variable, we can formulate the sampling process in the language of Bayesian probability. Our model uses a sequence of prediction and posterior update steps to iteratively narrow down the unknown sample starting from a broad initial belief. In addition to a rigorous theoretical analysis, we establish a connection between our model and diffusion models and show that it includes Bayesian Flow Networks (BFNs) as a special case. In our experiments, we demonstrate that our model improves sample quality on ImageNet32 over both BFNs and the closely related Variational Diffusion Models, while achieving equivalent log-likelihoods on ImageNet32 and CIFAR10. Find our code at https://github.com/martenlienen/bsi.

📄 PDF Abstract BibTeX arXiv:2502.07580

Code (1)

martenlienen/bsi 공식 구현 jax

Tasks

Density EstimationImage Generation

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

An invertible generative model for forward and inverse problems

2025-09-04 · Tristan van Leeuwen, Christoph Brune, Marcello Carioni arxiv

We formulate the inverse problem in a Bayesian framework and aim to train a generative model that allows us to simulate (i.e., sample from the likelihood) and do inference (i.e., sample from the posterior). We review the…

Posterior Mean Matching: Generative Modeling through Online Bayesian Inference

2024-12-17 · Sebastian Salazar, Michal Kucer, Yixin Wang, Emily Casleton 외

This paper introduces posterior mean matching (PMM), a new method for generative modeling that is grounded in Bayesian inference. PMM uses conjugate pairs of distributions to model complex data of various modalities like…

Bayesian InferenceImage GenerationLanguage ModelingLanguage Modelling

Bayesian Structure Learning with Generative Flow Networks

2022-02-28 · Tristan Deleu, António Góis, Chris Emezue, Mansi Rankawat 외

In Bayesian structure learning, we are interested in inferring a distribution over the directed acyclic graph (DAG) structure of Bayesian networks, from data. Defining such a distribution is very challenging, due to the …

Variational Inference

Stable generative modeling using Schrödinger bridges

2024-01-09 · Georg A. Gottwald, Fengyi Li, Youssef Marzouk, Sebastian Reich

We consider the problem of sampling from an unknown distribution for which only a sufficiently large number of training samples are available. Such settings have recently drawn considerable interest in the context of gen…

Bayesian Inference

Counterfactual Generative Modeling with Variational Causal Inference

2024-10-16 · Yulun Wu, Louie McConnell, Claudia Iriondo

Estimating an individual's counterfactual outcomes under interventions is a challenging task for traditional causal inference and supervised learning approaches when the outcome is high-dimensional (e.g. gene expressions…

Causal InferencecounterfactualDisentanglementVariational Inference