paper-with-me

홈 › Papers

A Parallel Technique for Multi-objective Bayesian Global Optimization: Using a Batch Selection of Probability of Improvement

2022-08-07 · Kaifeng Yang, Guozhi Dong, Michael Affenzeller

Bayesian global optimization (BGO) is an efficient surrogate-assisted technique for problems involving expensive evaluations. A parallel technique can be used to parallelly evaluate the true-expensive objective functions in one iteration to boost the execution time. An effective and straightforward approach is to design an acquisition function that can evaluate the performance of a bath of multiple solutions, instead of a single point/solution, in one iteration. This paper proposes five alternatives of \emph{Probability of Improvement} (PoI) with multiple points in a batch (q-PoI) for multi-objective Bayesian global optimization (MOBGO), taking the covariance among multiple points into account. Both exact computational formulas and the Monte Carlo approximation algorithms for all proposed q-PoIs are provided. Based on the distribution of the multiple points relevant to the Pareto-front, the position-dependent behavior of the five q-PoIs is investigated. Moreover, the five q-PoIs are compared with the other nine state-of-the-art and recently proposed batch MOBGO algorithms on twenty bio-objective benchmarks. The empirical experiments on different variety of benchmarks are conducted to demonstrate the effectiveness of two greedy q-PoIs ($\kpoi_{\mbox{best}}$ and $\kpoi_{\mbox{all}}$) on low-dimensional problems and the effectiveness of two explorative q-PoIs ($\kpoi_{\mbox{one}}$ and $\kpoi_{\mbox{worst}}$) on high-dimensional problems with difficult-to-approximate Pareto front boundaries.

📄 PDF Abstract BibTeX arXiv:2208.03685

Code (0)

등록된 구현이 없습니다.

Tasks

global-optimization

Similar Papers 제목 키워드 기반

Parallel Predictive Entropy Search for Batch Global Optimization of Expensive Objective Functions

2015-11-23 · NeurIPS 2015 12 · Amar Shah, Zoubin Ghahramani

We develop parallel predictive entropy search (PPES), a novel algorithm for Bayesian optimization of expensive black-box objective functions. At each iteration, PPES aims to select a batch of points which will maximize t…

Bayesian Optimizationglobal-optimization

SOBER: Highly Parallel Bayesian Optimization and Bayesian Quadrature over Discrete and Mixed Spaces

2023-01-27 · Masaki Adachi, Satoshi Hayakawa, Saad Hamid, Martin Jørgensen 외

Batch Bayesian optimisation and Bayesian quadrature have been shown to be sample-efficient methods of performing optimisation and quadrature where expensive-to-evaluate objective functions can be queried in parallel. How…

Bayesian OptimisationBayesian OptimizationDrug Discovery

Parallel Bayesian Optimization of Multiple Noisy Objectives with Expected Hypervolume Improvement

2021-05-17 · NeurIPS 2021 12 · Samuel Daulton, Maximilian Balandat, Eytan Bakshy

Optimizing multiple competing black-box objectives is a challenging problem in many fields, including science, engineering, and machine learning. Multi-objective Bayesian optimization (MOBO) is a sample-efficient approac…

Bayesian Optimization

Embarrassingly Parallel GFlowNets

2024-06-05 · Tiago da Silva, Luiz Max Carvalho, Amauri Souza, Samuel Kaski 외

GFlowNets are a promising alternative to MCMC sampling for discrete compositional random variables. Training GFlowNets requires repeated evaluations of the unnormalized target distribution or reward function. However, fo…

Multi-Objective Bayesian Optimization over High-Dimensional Search Spaces

2021-09-22 · Samuel Daulton, David Eriksson, Maximilian Balandat, Eytan Bakshy

Many real world scientific and industrial applications require optimizing multiple competing black-box objectives. When the objectives are expensive-to-evaluate, multi-objective Bayesian optimization (BO) is a popular ap…

Bayesian OptimizationVocal Bursts Intensity Prediction