paper-with-me

Papers

Bayesian computation with generative diffusion models by Multilevel Monte Carlo

2024-09-23 · Abdul-Lateef Haji-Ali, Marcelo Pereyra, Luke Shaw, Konstantinos Zygalakis

Generative diffusion models have recently emerged as a powerful strategy to perform stochastic sampling in Bayesian inverse problems, delivering remarkably accurate solutions for a wide range of challenging applications. However, diffusion models often require a large number of neural function evaluations per sample in order to deliver accurate posterior samples. As a result, using diffusion models as stochastic samplers for Monte Carlo integration in Bayesian computation can be highly computationally expensive, particularly in applications that require a substantial number of Monte Carlo samples for conducting uncertainty quantification analyses. This cost is especially high in large-scale inverse problems such as computational imaging, which rely on large neural networks that are expensive to evaluate. With quantitative imaging applications in mind, this paper presents a Multilevel Monte Carlo strategy that significantly reduces the cost of Bayesian computation with diffusion models. This is achieved by exploiting cost-accuracy trade-offs inherent to diffusion models to carefully couple models of different levels of accuracy in a manner that significantly reduces the overall cost of the calculation, without reducing the final accuracy. The proposed approach achieves a $4\times$-to-$8\times$ reduction in computational cost w.r.t. standard techniques across three benchmark imaging problems.

📄 PDF Abstract BibTeX arXiv:2409.15511

Code (1)

lshaw8317/mlmcfordms 공식 구현 jax

Tasks

Uncertainty Quantification

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

Multilevel Gibbs Sampling for Bayesian Regression

2020-09-25 · Joris Tavernier, Jaak Simm, Adam Arany, Karl Meerbergen 외

Bayesian regression remains a simple but effective tool based on Bayesian inference techniques. For large-scale applications, with complicated posterior distributions, Markov Chain Monte Carlo methods are applied. To imp…

Bayesian InferenceClusteringregression

Efficient Debiased Evidence Estimation by Multilevel Monte Carlo Sampling

2020-01-14 · Kei Ishikawa, Takashi Goda

In this paper, we propose a new stochastic optimization algorithm for Bayesian inference based on multilevel Monte Carlo (MLMC) methods. In Bayesian statistics, biased estimators of the model evidence have been often use…

Bayesian InferenceStochastic Optimization

Multilevel Monte Carlo for Scalable Bayesian Computations

2016-09-15 · Mike Giles, Tigran Nagapetyan, Lukasz Szpruch, Sebastian Vollmer 외

Markov chain Monte Carlo (MCMC) algorithms are ubiquitous in Bayesian computations. However, they need to access the full data set in order to evaluate the posterior density at every step of the algorithm. This results i…

Solving Linear-Gaussian Bayesian Inverse Problems with Decoupled Diffusion Sequential Monte Carlo

2025-02-10 · Filip Ekström Kelvinius, Zheng Zhao, Fredrik Lindsten

A recent line of research has exploited pre-trained generative diffusion models as priors for solving Bayesian inverse problems. We contribute to this research direction by designing a sequential Monte Carlo method for l…

Accelerating Multilevel Markov Chain Monte Carlo Using Machine Learning Models

2024-05-18 · Sohail Reddy, Hillary Fairbanks

This work presents an efficient approach for accelerating multilevel Markov Chain Monte Carlo (MCMC) sampling for large-scale problems using low-fidelity machine learning models. While conventional techniques for large-s…

Bayesian Inference