Parallel Gaussian process surrogate Bayesian inference with noisy likelihood evaluations
We consider Bayesian inference when only a limited number of noisy log-likelihood evaluations can be obtained. This occurs for example when complex simulator-based statistical models are fitted to data, and synthetic likelihood (SL) method is used to form the noisy log-likelihood estimates using computationally costly forward simulations. We frame the inference task as a sequential Bayesian experimental design problem, where the log-likelihood function is modelled with a hierarchical Gaussian process (GP) surrogate model, which is used to efficiently select additional log-likelihood evaluation locations. Motivated by recent progress in the related problem of batch Bayesian optimisation, we develop various batch-sequential design strategies which allow to run some of the potentially costly simulations in parallel. We analyse the properties of the resulting method theoretically and empirically. Experiments with several toy problems and simulation models suggest that our method is robust, highly parallelisable, and sample-efficient.
Code (1)
Tasks
Bayesian InferenceBayesian OptimisationExperimental DesignMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Adaptive Gaussian process surrogates for Bayesian inference
We present an adaptive approach to the construction of Gaussian process surrogates for Bayesian inference with expensive-to-evaluate forward models. Our method relies on the fully Bayesian approach to training Gaussian p…
Bayesian Inferenceglobal-optimizationBatch simulations and uncertainty quantification in Gaussian process surrogate-based approximate Bayesian computation
Surrogate models can be used to accelerate approximate Bayesian computation (ABC). In one such framework the discrepancy between simulated and observed data is modelled with a Gaussian process. So far principled strategi…
Uncertainty QuantificationLikelihood-Free Inference with Deep Gaussian Processes
In recent years, surrogate models have been successfully used in likelihood-free inference to decrease the number of simulator evaluations. The current state-of-the-art performance for this task has been achieved by Baye…
Bayesian OptimizationGaussian ProcessesSurrogate modeling for Bayesian optimization beyond a single Gaussian process
Bayesian optimization (BO) has well-documented merits for optimizing black-box functions with an expensive evaluation cost. Such functions emerge in applications as diverse as hyperparameter tuning, drug discovery, and r…
Bayesian OptimizationDrug DiscoveryThompson SamplingParallel MCMC Without Embarrassing Failures
Embarrassingly parallel Markov Chain Monte Carlo (MCMC) exploits parallel computing to scale Bayesian inference to large datasets by using a two-step approach. First, MCMC is run in parallel on (sub)posteriors defined on…
Active LearningBayesian Inference