paper-with-me

Papers

Asynchronous ε-Greedy Bayesian Optimisation

2020-10-15 · George De Ath, Richard M. Everson, Jonathan E. Fieldsend

Batch Bayesian optimisation (BO) is a successful technique for the optimisation of expensive black-box functions. Asynchronous BO can reduce wallclock time by starting a new evaluation as soon as another finishes, thus maximising resource utilisation. To maximise resource allocation, we develop a novel asynchronous BO method, AEGiS (Asynchronous $\epsilon$-Greedy Global Search) that combines greedy search, exploiting the surrogate's mean prediction, with Thompson sampling and random selection from the approximate Pareto set describing the trade-off between exploitation (surrogate mean prediction) and exploration (surrogate posterior variance). We demonstrate empirically the efficacy of AEGiS on synthetic benchmark problems, meta-surrogate hyperparameter tuning problems and real-world problems, showing that AEGiS generally outperforms existing methods for asynchronous BO. When a single worker is available performance is no worse than BO using expected improvement.

📄 PDF Abstract BibTeX arXiv:2010.07615

Code (1)

georgedeath/aegis 공식 구현 pytorch

Tasks

Bayesian OptimisationThompson Sampling

Similar Papers 제목 키워드 기반

Asynchronous Batch Bayesian Optimisation with Improved Local Penalisation

2019-01-29 · Ahsan S. Alvi, Binxin Ru, Jan Calliess, Stephen J. Roberts 외

Batch Bayesian optimisation (BO) has been successfully applied to hyperparameter tuning using parallel computing, but it is wasteful of resources: workers that complete jobs ahead of others are left idle. We address this…

Bayesian Optimisation

Asynchronous Parallel Bayesian Optimisation via Thompson Sampling

2017-05-25 · Kirthevasan Kandasamy, Akshay Krishnamurthy, Jeff Schneider, Barnabas Poczos

We design and analyse variations of the classical Thompson sampling (TS) procedure for Bayesian optimisation (BO) in settings where function evaluations are expensive, but can be performed in parallel. Our theoretical an…

Bayesian OptimisationThompson Sampling

Greed is Good: Exploration and Exploitation Trade-offs in Bayesian Optimisation

2019-11-28 · George De Ath, Richard M. Everson, Alma A. M. Rahat, Jonathan E. Fieldsend

The performance of acquisition functions for Bayesian optimisation to locate the global optimum of continuous functions is investigated in terms of the Pareto front between exploration and exploitation. We show that Expe…

Active LearningBayesian Optimisation

Search Strategies for Self-driving Laboratories with Pending Experiments

2023-12-06 · Hao Wen, Jakob Zeitler, Connor Rupnow

Self-driving laboratories (SDLs) consist of multiple stations that perform material synthesis and characterisation tasks. To minimize station downtime and maximize experimental throughput, it is practical to run experime…

Bayesian Optimisation

Multi-objective optimisation via the R2 utilities

2023-05-19 · Ben Tu, Nikolas Kantas, Robert M. Lee, Behrang Shafei

The goal of multi-objective optimisation is to identify a collection of points which describe the best possible trade-offs between the multiple objectives. In order to solve this vector-valued optimisation problem, pract…

Bayesian OptimisationBayesian Optimization