paper-with-me

홈 › Papers

Efficient Computation of Expected Hypervolume Improvement Using Box Decomposition Algorithms

2019-04-26 · Kaifeng Yang, Michael Emmerich, André Deutz, Thomas Bäck

In the field of multi-objective optimization algorithms, multi-objective Bayesian Global Optimization (MOBGO) is an important branch, in addition to evolutionary multi-objective optimization algorithms (EMOAs). MOBGO utilizes Gaussian Process models learned from previous objective function evaluations to decide the next evaluation site by maximizing or minimizing an infill criterion. A common criterion in MOBGO is the Expected Hypervolume Improvement (EHVI), which shows a good performance on a wide range of problems, with respect to exploration and exploitation. However, so far it has been a challenge to calculate exact EHVI values efficiently. In this paper, an efficient algorithm for the computation of the exact EHVI for a generic case is proposed. This efficient algorithm is based on partitioning the integration volume into a set of axis-parallel slices. Theoretically, the upper bound time complexities are improved from previously $O (n^2)$ and $O(n^3)$, for two- and three-objective problems respectively, to $\Theta(n\log n)$, which is asymptotically optimal. This article generalizes the scheme in higher dimensional case by utilizing a new hyperbox decomposition technique, which was proposed by D{\"a}chert et al, EJOR, 2017. It also utilizes a generalization of the multilayered integration scheme that scales linearly in the number of hyperboxes of the decomposition. The speed comparison shows that the proposed algorithm in this paper significantly reduces computation time. Finally, this decomposition technique is applied in the calculation of the Probability of Improvement (PoI).

📄 PDF Abstract BibTeX arXiv:1904.12672

Code (0)

등록된 구현이 없습니다.

Tasks

global-optimization

Methods 이 논문이 사용한 방법론

SPEED The monocular depth estimation (MDE) is the task of estimating depth from a single frame. This information is an essential knowledge in many computer vision tasks such as scene…
Gaussian Process Gaussian Processes are non-parametric models for approximating functions. They rely upon a measure of similarity between points (the kernel function) to predict the value for…

Similar Papers 제목 키워드 기반

Fast Exact Computation of Expected HyperVolume Improvement

2018-12-18 · Guang Zhao, Raymundo Arroyave, Xiaoning Qian

In multi-objective Bayesian optimization and surrogate-based evolutionary algorithms, Expected HyperVolume Improvement (EHVI) is widely used as the acquisition function to guide the search approaching the Pareto front. T…

Bayesian OptimizationEvolutionary Algorithms

Differentiable Expected Hypervolume Improvement for Parallel Multi-Objective Bayesian Optimization

2020-06-09 · NeurIPS 2020 12 · Samuel Daulton, Maximilian Balandat, Eytan Bakshy

In many real-world scenarios, decision makers seek to efficiently optimize multiple competing objectives in a sample-efficient fashion. Multi-objective Bayesian optimization (BO) is a common approach, but many of the bes…

Bayesian OptimizationSecond-order methods

Preference-Shaped Expected Hypervolume and R2 Improvement: Exact Computation and Monotonicity

2026-05-27 · Michael T. M. Emmerich arxiv

This paper studies preference-shaped expected improvement criteria for Bayesian multiobjective optimization. We consider two indicator families which are often used for similar algorithmic purposes, but which are geometr…

Probability Distribution of Hypervolume Improvement in Bi-objective Bayesian Optimization

2022-05-11 · Hao Wang, Kaifeng Yang, Michael Affenzeller

Hypervolume improvement (HVI) is commonly employed in multi-objective Bayesian optimization algorithms to define acquisition functions due to its Pareto-compliant property. Rather than focusing on specific statistical mo…

Bayesian Optimization

What Makes an Effective Scalarising Function for Multi-Objective Bayesian Optimisation?

2021-04-10 · Clym Stock-Williams, Tinkle Chugh, Alma Rahat, Wei Yu

Performing multi-objective Bayesian optimisation by scalarising the objectives avoids the computation of expensive multi-dimensional integral-based acquisition functions, instead of allowing one-dimensional standard acqu…

Bayesian Optimisation