Design Amortization for Bayesian Optimal Experimental Design
Bayesian optimal experimental design is a sub-field of statistics focused on developing methods to make efficient use of experimental resources. Any potential design is evaluated in terms of a utility function, such as the (theoretically well-justified) expected information gain (EIG); unfortunately however, under most circumstances the EIG is intractable to evaluate. In this work we build off of successful variational approaches, which optimize a parameterized variational model with respect to bounds on the EIG. Past work focused on learning a new variational model from scratch for each new design considered. Here we present a novel neural architecture that allows experimenters to optimize a single variational model that can estimate the EIG for potentially infinitely many designs. To further improve computational efficiency, we also propose to train the variational model on a significantly cheaper-to-evaluate lower bound, and show empirically that the resulting model provides an excellent guide for more accurate, but expensive to evaluate bounds on the EIG. We demonstrate the effectiveness of our technique on generalized linear models, a class of statistical models that is widely used in the analysis of controlled experiments. Experiments show that our method is able to greatly improve accuracy over existing approximation strategies, and achieve these results with far better sample efficiency.
Code (0)
등록된 구현이 없습니다.
Tasks
Computational EfficiencyExperimental DesignSimilar Papers 제목 키워드 기반
Nesting Particle Filters for Experimental Design in Dynamical Systems
In this paper, we propose a novel approach to Bayesian experimental design for non-exchangeable data that formulates it as risk-sensitive policy optimization. We develop the Inside-Out SMC$^2$ algorithm, a nested sequent…
Experimental DesignOptimizing Sequential Experimental Design with Deep Reinforcement Learning
Bayesian approaches developed to solve the optimal design of sequential experiments are mathematically elegant but computationally challenging. Recently, techniques using amortization have been proposed to make these Bay…
Deep Reinforcement LearningExperimental Designreinforcement-learningReinforcement Learning+1ALINE: Joint Amortization for Bayesian Inference and Active Data Acquisition
Many critical applications, from autonomous scientific discovery to personalized medicine, demand systems that can both strategically acquire the most informative data and instantaneously perform inference based upon it.…
Active LearningBayesian InferenceExperimental Designscientific discoveryAmortized Inference for Gaussian Process Hyperparameters of Structured Kernels
Learning the kernel parameters for Gaussian processes is often the computational bottleneck in applications such as online learning, Bayesian optimization, or active learning. Amortizing parameter inference over differen…
Active LearningBayesian OptimizationGaussian ProcessesRobust Experimental Design via Generalised Bayesian Inference
Bayesian optimal experimental design is a principled framework for conducting experiments that leverages Bayesian inference to quantify how much information one can expect to gain from selecting a certain design. However…
Bayesian Inference