paper-with-me

Papers

Practical Batch Bayesian Optimization for Less Expensive Functions

2018-11-05 · Vu Nguyen, Sunil Gupta, Santu Rana, Cheng Li, Svetha Venkatesh

Bayesian optimization (BO) and its batch extensions are successful for optimizing expensive black-box functions. However, these traditional BO approaches are not yet ideal for optimizing less expensive functions when the computational cost of BO can dominate the cost of evaluating the blackbox function. Examples of these less expensive functions are cheap machine learning models, inexpensive physical experiment through simulators, and acquisition function optimization in Bayesian optimization. In this paper, we consider a batch BO setting for situations where function evaluations are less expensive. Our model is based on a new exploration strategy using geometric distance that provides an alternative way for exploration, selecting a point far from the observed locations. Using that intuition, we propose to use Sobol sequence to guide exploration that will get rid of running multiple global optimization steps as used in previous works. Based on the proposed distance exploration, we present an efficient batch BO approach. We demonstrate that our approach outperforms other baselines and global optimization methods when the function evaluations are less expensive.

📄 PDF Abstract BibTeX arXiv:1811.01466

Code (0)

등록된 구현이 없습니다.

Tasks

Bayesian Optimizationglobal-optimization

Similar Papers 제목 키워드 기반

Batch Bayesian Optimization on Permutations using the Acquisition Weighted Kernel

2021-02-26 · Changyong Oh, Roberto Bondesan, Efstratios Gavves, Max Welling

In this work we propose a batch Bayesian optimization method for combinatorial problems on permutations, which is well suited for expensive-to-evaluate objectives. We first introduce LAW, an efficient batch acquisition m…

Bayesian OptimizationPoint ProcessesScheduling

Parallel Predictive Entropy Search for Batch Global Optimization of Expensive Objective Functions

2015-11-23 · NeurIPS 2015 12 · Amar Shah, Zoubin Ghahramani

We develop parallel predictive entropy search (PPES), a novel algorithm for Bayesian optimization of expensive black-box objective functions. At each iteration, PPES aims to select a batch of points which will maximize t…

Bayesian Optimizationglobal-optimization

Batch Bayesian Optimization via Multi-objective Acquisition Ensemble for Automated Analog Circuit Design

2018-07-01 · ICML 2018 7 · Wenlong Lyu, Fan Yang, Changhao Yan, Dian Zhou 외

Bayesian optimization methods are promising for the optimization of black-box functions that are expensive to evaluate. In this paper, a novel batch Bayesian optimization approach is proposed. The parallelization is…

Bayesian Optimization

Batch Bayesian Optimization via Particle Gradient Flows

2022-09-10 · Enrico Crovini, Simon L. Cotter, Konstantinos Zygalakis, Andrew B. Duncan

Bayesian Optimisation (BO) methods seek to find global optima of objective functions which are only available as a black-box or are expensive to evaluate. Such methods construct a surrogate model for the objective functi…

Bayesian InferenceBayesian OptimisationBayesian Optimization

Practical Two-Step Lookahead Bayesian Optimization

2019-12-01 · NeurIPS 2019 12 · Jian Wu, Peter Frazier

Expected improvement and other acquisition functions widely used in Bayesian optimization use a "one-step" assumption: they value objective function evaluations assuming no future evaluations will be performed. Because w…

Bayesian OptimizationVocal Bursts Valence Prediction