Bayesian Experimental Design for Implicit Models by Mutual Information Neural Estimation
Implicit stochastic models, where the data-generation distribution is intractable but sampling is possible, are ubiquitous in the natural sciences. The models typically have free parameters that need to be inferred from data collected in scientific experiments. A fundamental question is how to design the experiments so that the collected data are most useful. The field of Bayesian experimental design advocates that, ideally, we should choose designs that maximise the mutual information (MI) between the data and the parameters. For implicit models, however, this approach is severely hampered by the high computational cost of computing posteriors and maximising MI, in particular when we have more than a handful of design variables to optimise. In this paper, we propose a new approach to Bayesian experimental design for implicit models that leverages recent advances in neural MI estimation to deal with these issues. We show that training a neural network to maximise a lower bound on MI allows us to jointly determine the optimal design and the posterior. Simulation studies illustrate that this gracefully extends Bayesian experimental design for implicit models to higher design dimensions.
Code (1)
Tasks
Experimental DesignSimilar Papers 제목 키워드 기반
Gradient-based Bayesian Experimental Design for Implicit Models using Mutual Information Lower Bounds
We introduce a framework for Bayesian experimental design (BED) with implicit models, where the data-generating distribution is intractable but sampling from it is still possible. In order to find optimal experimental de…
EpidemiologyExperimental Designparameter estimationSequential Bayesian Experimental Design for Implicit Models via Mutual Information
Bayesian experimental design (BED) is a framework that uses statistical models and decision making under uncertainty to optimise the cost and performance of a scientific experiment. Sequential BED, as opposed to static B…
Bayesian OptimisationDecision MakingDecision Making Under UncertaintyExperimental Design+1Efficient Bayesian Experimental Design for Implicit Models
Bayesian experimental design involves the optimal allocation of resources in an experiment, with the aim of optimising cost and performance. For implicit models, where the likelihood is intractable but sampling from the …
Bayesian OptimisationExperimental DesignA Scalable Gradient-Free Method for Bayesian Experimental Design with Implicit Models
Bayesian experimental design (BED) is to answer the question that how to choose designs that maximize the information gathering. For implicit models, where the likelihood is intractable but sampling is possible, conventi…
Experimental DesignA Hybrid Gradient Method to Designing Bayesian Experiments for Implicit Models
Bayesian experimental design (BED) aims at designing an experiment to maximize the information gathering from the collected data. The optimal design is usually achieved by maximizing the mutual information (MI) between t…
Experimental Design