paper-with-me

Papers

Accelerating Multilevel Markov Chain Monte Carlo Using Machine Learning Models

2024-05-18 · Sohail Reddy, Hillary Fairbanks

This work presents an efficient approach for accelerating multilevel Markov Chain Monte Carlo (MCMC) sampling for large-scale problems using low-fidelity machine learning models. While conventional techniques for large-scale Bayesian inference often substitute computationally expensive high-fidelity models with machine learning models, thereby introducing approximation errors, our approach offers a computationally efficient alternative by augmenting high-fidelity models with low-fidelity ones within a hierarchical framework. The multilevel approach utilizes the low-fidelity machine learning model (MLM) for inexpensive evaluation of proposed samples thereby improving the acceptance of samples by the high-fidelity model. The hierarchy in our multilevel algorithm is derived from geometric multigrid hierarchy. We utilize an MLM to acclerate the coarse level sampling. Training machine learning model for the coarsest level significantly reduces the computational cost associated with generating training data and training the model. We present an MCMC algorithm to accelerate the coarsest level sampling using MLM and account for the approximation error introduced. We provide theoretical proofs of detailed balance and demonstrate that our multilevel approach constitutes a consistent MCMC algorithm. Additionally, we derive conditions on the accuracy of the machine learning model to facilitate more efficient hierarchical sampling. Our technique is demonstrated on a standard benchmark inference problem in groundwater flow, where we estimate the probability density of a quantity of interest using a four-level MCMC algorithm. Our proposed algorithm accelerates multilevel sampling by a factor of two while achieving similar accuracy compared to sampling using the standard multilevel algorithm.

📄 PDF Abstract BibTeX arXiv:2405.11179

Code (0)

등록된 구현이 없습니다.

Tasks

Bayesian Inference

Similar Papers 제목 키워드 기반

Multilevel Gibbs Sampling for Bayesian Regression

2020-09-25 · Joris Tavernier, Jaak Simm, Adam Arany, Karl Meerbergen 외

Bayesian regression remains a simple but effective tool based on Bayesian inference techniques. For large-scale applications, with complicated posterior distributions, Markov Chain Monte Carlo methods are applied. To imp…

Bayesian InferenceClusteringregression

Multilevel Monte Carlo for Scalable Bayesian Computations

2016-09-15 · Mike Giles, Tigran Nagapetyan, Lukasz Szpruch, Sebastian Vollmer 외

Markov chain Monte Carlo (MCMC) algorithms are ubiquitous in Bayesian computations. However, they need to access the full data set in order to evaluate the posterior density at every step of the algorithm. This results i…

Multilevel Monte Carlo for a class of Partially Observed Processes in Neuroscience

2023-10-10 · Mohamed Maama, Ajay Jasra, Kengo Kamatani

In this paper we consider Bayesian parameter inference associated to a class of partially observed stochastic differential equations (SDE) driven by jump processes. Such type of models can be routinely found in applicati…

Accelerating Langevin Monte Carlo Sampling: A Large Deviations Analysis

2025-03-24 · Nian Yao, Pervez Ali, Xihua Tao, Lingjiong Zhu

Langevin algorithms are popular Markov chain Monte Carlo methods that are often used to solve high-dimensional large-scale sampling problems in machine learning. The most classical Langevin Monte Carlo algorithm is based…

Accelerating Look-ahead in Bayesian Optimization: Multilevel Monte Carlo is All you Need

2024-02-03 · Shangda Yang, Vitaly Zankin, Maximilian Balandat, Stefan Scherer 외

We leverage multilevel Monte Carlo (MLMC) to improve the performance of multi-step look-ahead Bayesian optimization (BO) methods that involve nested expectations and maximizations. Often these expectations must be comput…

AllBayesian Optimization