Efficient batch-sequential Bayesian optimization with moments of truncated Gaussian vectors
We deal with the efficient parallelization of Bayesian global optimization algorithms, and more specifically of those based on the expected improvement criterion and its variants. A closed form formula relying on multivariate Gaussian cumulative distribution functions is established for a generalized version of the multipoint expected improvement criterion. In turn, the latter relies on intermediate results that could be of independent interest concerning moments of truncated Gaussian vectors. The obtained expansion of the criterion enables studying its differentiability with respect to point batches and calculating the corresponding gradient in closed form. Furthermore , we derive fast numerical approximations of this gradient and propose efficient batch optimization strategies. Numerical experiments illustrate that the proposed approaches enable computational savings of between one and two order of magnitudes, hence enabling derivative-based batch-sequential acquisition function maximization to become a practically implementable and efficient standard.
Code (0)
등록된 구현이 없습니다.
Tasks
Bayesian OptimizationFormglobal-optimizationSimilar Papers 제목 키워드 기반
Batch Bayesian Optimization via Simulation Matching
Bayesian optimization methods are often used to optimize unknown functions that are costly to evaluate. Typically, these methods sequentially select inputs to be evaluated one at a time based on a posterior over the unkn…
Bayesian OptimizationCombining Multi-Fidelity Modelling and Asynchronous Batch Bayesian Optimization
Bayesian Optimization is a useful tool for experiment design. Unfortunately, the classical, sequential setting of Bayesian Optimization does not translate well into laboratory experiments, for instance battery design, wh…
Bayesian OptimizationBatch simulations and uncertainty quantification in Gaussian process surrogate approximate Bayesian computation
The computational efficiency of approximate Bayesian computation (ABC) has been improved by using surrogate models such as Gaussian processes (GP). In one such promising framework the discrepancy between the simulated an…
Bayesian OptimisationComputational EfficiencyExperimental DesignGaussian Processes+1Process-constrained batch Bayesian approaches for yield optimization in multi-reactor systems
The optimization of yields in multi-reactor systems, which are advanced tools in heterogeneous catalysis research, presents a significant challenge due to hierarchical technical constraints. To this respect, this work in…
Bayesian OptimizationThompson SamplingA Simple and Efficient Approach to Batch Bayesian Optimization
Extending Bayesian optimization to batch evaluation can enable the designer to make the most use of parallel computing technology. However, most of current batch approaches do not scale well with the batch size. That is,…
Bayesian Optimization