Distributional Bayesian optimisation for variational inference on black-box simulators
Inverse problems are ubiquitous in natural sciences and refer to the challenging task of inferring complex and potentially multi-modal posterior distributions over hidden parameters given a set of observations. Typically, a model of the physical process in the form of differential equations is available but leads to intractable inference over its parameters. While the forward propagation of parameters through the model simulates the evolution of the system, the inverse problem of finding the parameters given the sequence of states is not unique. In this work, we propose a generalisation of the Bayesian optimisation framework to approximate inference. The resulting method learns approximations to the posterior distribution by applying Stein variational gradient descent on top of estimates from a Gaussian process model. Preliminary results demonstrate the method's performance on likelihood-free inference for reinforcement learning environments.
Code (1)
Tasks
Bayesian OptimisationVariational InferenceSimilar Papers 제목 키워드 기반
Ensemble Distributionally Robust Bayesian Optimisation with Continuous Context
We study Bayesian Optimisation (BO) in settings where the objective function is influenced by uncontrollable environmental contexts governed by an unknown probability distribution. In practice, the contextual distributio…
Distributionally Robust Optimisation with Bayesian Ambiguity Sets
Decision making under uncertainty is challenging since the data-generating process (DGP) is often unknown. Bayesian inference proceeds by estimating the DGP through posterior beliefs about the model's parameters. However…
Bayesian InferenceDecision MakingDecision Making Under UncertaintyRao-Blackwellised Reparameterisation Gradients
Latent Gaussian variables have been popularised in probabilistic machine learning. In turn, gradient estimators are the machinery that facilitates gradient-based optimisation for models with latent Gaussian variables. Th…
Variational InferenceHigh-Dimensional Bayesian Optimisation with Variational Autoencoders and Deep Metric Learning
We introduce a method combining variational autoencoders (VAEs) and deep metric learning to perform Bayesian optimisation (BO) over high-dimensional and structured input spaces. By adapting ideas from deep metric learnin…
Bayesian OptimisationMetric LearningMolecular Graph GenerationVocal Bursts Intensity PredictionA Rigorous Link between Deep Ensembles and (Variational) Bayesian Methods
We establish the first mathematically rigorous link between Bayesian, variational Bayesian, and ensemble methods. A key step towards this it to reformulate the non-convex optimisation problem typically encountered in dee…
Deep LearningUncertainty QuantificationVariational Inference