paper-with-me

홈 › Papers

Multi-fidelity Monte Carlo: a pseudo-marginal approach

2022-10-04 · Diana Cai, Ryan P. Adams

Markov chain Monte Carlo (MCMC) is an established approach for uncertainty quantification and propagation in scientific applications. A key challenge in applying MCMC to scientific domains is computation: the target density of interest is often a function of expensive computations, such as a high-fidelity physical simulation, an intractable integral, or a slowly-converging iterative algorithm. Thus, using an MCMC algorithms with an expensive target density becomes impractical, as these expensive computations need to be evaluated at each iteration of the algorithm. In practice, these computations often approximated via a cheaper, low-fidelity computation, leading to bias in the resulting target density. Multi-fidelity MCMC algorithms combine models of varying fidelities in order to obtain an approximate target density with lower computational cost. In this paper, we describe a class of asymptotically exact multi-fidelity MCMC algorithms for the setting where a sequence of models of increasing fidelity can be computed that approximates the expensive target density of interest. We take a pseudo-marginal MCMC approach for multi-fidelity inference that utilizes a cheaper, randomized-fidelity unbiased estimator of the target fidelity constructed via random truncation of a telescoping series of the low-fidelity sequence of models. Finally, we discuss and evaluate the proposed multi-fidelity MCMC approach on several applications, including log-Gaussian Cox process modeling, Bayesian ODE system identification, PDE-constrained optimization, and Gaussian process regression parameter inference.

📄 PDF Abstract BibTeX arXiv:2210.01534

Code (0)

등록된 구현이 없습니다.

Tasks

Uncertainty Quantification

Methods 이 논문이 사용한 방법론

Gaussian Process Gaussian Processes are non-parametric models for approximating functions. They rely upon a measure of similarity between points (the kernel function) to predict the value for…

Similar Papers 제목 키워드 기반

Pseudo-Marginal Hamiltonian Monte Carlo

2016-07-08 · Johan Alenlöv, Arnaud Doucet, Fredrik Lindsten

Bayesian inference in the presence of an intractable likelihood function is computationally challenging. When following a Markov chain Monte Carlo (MCMC) approach to approximate the posterior distribution in this context…

Bayesian Inference

A Multi-armed Bandit MCMC, with applications in sampling from doubly intractable posterior

2019-03-13 · Guanyang Wang

Markov chain Monte Carlo (MCMC) algorithms are widely used to sample from complicated distributions, especially to sample from the posterior distribution in Bayesian inference. However, MCMC is not directly applicable wh…

Bayesian Inference

Asynchronous Anytime Sequential Monte Carlo

2014-07-10 · NeurIPS 2014 12 · Brooks Paige, Frank Wood, Arnaud Doucet, Yee Whye Teh

We introduce a new sequential Monte Carlo algorithm we call the particle cascade. The particle cascade is an asynchronous, anytime alternative to traditional particle filtering algorithms. It uses no barrier synchronizat…

Marginal sequential Monte Carlo for doubly intractable models

2017-10-12 · Richard G. Everitt, Dennis Prangle, Philip Maybank, Mark Bell

Bayesian inference for models that have an intractable partition function is known as a doubly intractable problem, where standard Monte Carlo methods are not applicable. The past decade has seen the development of auxil…

Bayesian Inference

Corrected Integrated Laplace Approximation for Bayesian Inference in Latent Gaussian Models

2026-05-19 · Jinlin Lai, Charles C. Margossian, Daniel R. Sheldon arxiv

Latent Gaussian models (LGMs) are a popular class of Bayesian hierarchical models that include Gaussian processes, as well as certain spatial models and mixed-effect models. Efficient Bayesian inference of LGMs often req…

Bayesian InferenceGaussian Processes