Robust Bayesian Inference for Simulator-based Models via the MMD Posterior Bootstrap
Simulator-based models are models for which the likelihood is intractable but simulation of synthetic data is possible. They are often used to describe complex real-world phenomena, and as such can often be misspecified in practice. Unfortunately, existing Bayesian approaches for simulators are known to perform poorly in those cases. In this paper, we propose a novel algorithm based on the posterior bootstrap and maximum mean discrepancy estimators. This leads to a highly-parallelisable Bayesian inference algorithm with strong robustness properties. This is demonstrated through an in-depth theoretical study which includes generalisation bounds and proofs of frequentist consistency and robustness of our posterior. The approach is then assessed on a range of examples including a g-and-k distribution and a toggle-switch model.
Code (1)
Tasks
Bayesian InferenceSimilar Papers 제목 키워드 기반
Parametric Bootstrap Ensembles as Variational Inference
In this paper, we employ variational arguments to establish a connection between ensemble methods for Neural Networks and Bayesian inference. We consider an ensemble-based scheme where each model/particle corresponds to …
Bayesian InferenceVariational InferenceBootstrapped synthetic likelihood
Approximate Bayesian computation (ABC) and synthetic likelihood (SL) techniques have enabled the use of Bayesian inference for models that may be simulated, but for which the likelihood cannot be evaluated pointwise at v…
Bayesian InferenceScalable Nonparametric Sampling from Multimodal Posteriors with the Posterior Bootstrap
Increasingly complex datasets pose a number of challenges for Bayesian inference. Conventional posterior sampling based on Markov chain Monte Carlo can be too computationally intensive, is serial in nature and mixes poor…
Bayesian InferenceregressionGeneralized Posteriors in Approximate Bayesian Computation
Complex simulators have become a ubiquitous tool in many scientific disciplines, providing high-fidelity, implicit probabilistic models of natural and social phenomena. Unfortunately, they typically lack the tractability…
Bayesian InferenceNeural Posterior Estimation with Differentiable Simulators
Simulation-Based Inference (SBI) is a promising Bayesian inference framework that alleviates the need for analytic likelihoods to estimate posterior distributions. Recent advances using neural density estimators in SBI a…
Bayesian InferenceDensity EstimationPhysical Simulations