Efficient Bayesian Experimental Design for Implicit Models
Bayesian experimental design involves the optimal allocation of resources in an experiment, with the aim of optimising cost and performance. For implicit models, where the likelihood is intractable but sampling from the model is possible, this task is particularly difficult and therefore largely unexplored. This is mainly due to technical difficulties associated with approximating posterior distributions and utility functions. We devise a novel experimental design framework for implicit models that improves upon previous work in two ways. First, we use the mutual information between parameters and data as the utility function, which has previously not been feasible. We achieve this by utilising Likelihood-Free Inference by Ratio Estimation (LFIRE) to approximate posterior distributions, instead of the traditional approximate Bayesian computation or synthetic likelihood methods. Secondly, we use Bayesian optimisation in order to solve the optimal design problem, as opposed to the typically used grid search or sampling-based methods. We find that this increases efficiency and allows us to consider higher design dimensions.
Code (1)
Tasks
Bayesian OptimisationExperimental DesignSimilar Papers 제목 키워드 기반
Bayesian Experimental Design for Implicit Models by Mutual Information Neural Estimation
Implicit stochastic models, where the data-generation distribution is intractable but sampling is possible, are ubiquitous in the natural sciences. The models typically have free parameters that need to be inferred from …
Experimental DesignSequential Bayesian Experimental Design for Implicit Models via Mutual Information
Bayesian experimental design (BED) is a framework that uses statistical models and decision making under uncertainty to optimise the cost and performance of a scientific experiment. Sequential BED, as opposed to static B…
Bayesian OptimisationDecision MakingDecision Making Under UncertaintyExperimental Design+1Gradient-based Bayesian Experimental Design for Implicit Models using Mutual Information Lower Bounds
We introduce a framework for Bayesian experimental design (BED) with implicit models, where the data-generating distribution is intractable but sampling from it is still possible. In order to find optimal experimental de…
EpidemiologyExperimental Designparameter estimationPolicy-Based Bayesian Experimental Design for Non-Differentiable Implicit Models
For applications in healthcare, physics, energy, robotics, and many other fields, designing maximally informative experiments is valuable, particularly when experiments are expensive, time-consuming, or pose safety hazar…
Deep Reinforcement LearningExperimental Designreinforcement-learningReinforcement Learning+1A Scalable Gradient-Free Method for Bayesian Experimental Design with Implicit Models
Bayesian experimental design (BED) is to answer the question that how to choose designs that maximize the information gathering. For implicit models, where the likelihood is intractable but sampling is possible, conventi…
Experimental Design