paper-with-me

홈 › Papers

Bounding Box-based Multi-objective Bayesian Optimization of Risk Measures under Input Uncertainty

2023-01-27 · Yu Inatsu, Shion Takeno, Hiroyuki Hanada, Kazuki Iwata, Ichiro Takeuchi

In this study, we propose a novel multi-objective Bayesian optimization (MOBO) method to efficiently identify the Pareto front (PF) defined by risk measures for black-box functions under the presence of input uncertainty (IU). Existing BO methods for Pareto optimization in the presence of IU are risk-specific or without theoretical guarantees, whereas our proposed method addresses general risk measures and has theoretical guarantees. The basic idea of the proposed method is to assume a Gaussian process (GP) model for the black-box function and to construct high-probability bounding boxes for the risk measures using the GP model. Furthermore, in order to reduce the uncertainty of non-dominated bounding boxes, we propose a method of selecting the next evaluation point using a maximin distance defined by the maximum value of a quasi distance based on bounding boxes. As theoretical analysis, we prove that the algorithm can return an arbitrary-accurate solution in a finite number of iterations with high probability, for various risk measures such as Bayes risk, worst-case risk, and value-at-risk. We also give a theoretical analysis that takes into account approximation errors because there exist non-negligible approximation errors (e.g., finite approximation of PFs and sampling-based approximation of bounding boxes) in practice. We confirm that the proposed method outperforms compared with existing methods not only in the setting with IU but also in the setting of ordinary MOBO through numerical experiments.

📄 PDF Abstract BibTeX arXiv:2301.11588

Code (0)

등록된 구현이 없습니다.

Tasks

Bayesian Optimization

Methods 이 논문이 사용한 방법론

Gaussian Process Gaussian Processes are non-parametric models for approximating functions. They rely upon a measure of similarity between points (the kernel function) to predict the value for…

Similar Papers 제목 키워드 기반

A Robust Multi-Objective Bayesian Optimization Framework Considering Input Uncertainty

2022-02-25 · J. Qing, I. Couckuyt, T. Dhaene

Bayesian optimization is a popular tool for data-efficient optimization of expensive objective functions. In real-life applications like engineering design, the designer often wants to take multiple objectives as well as…

Bayesian Optimization

Unbounded Bayesian Optimization via Regularization

2015-08-14 · Bobak Shahriari, Alexandre Bouchard-Côté, Nando de Freitas

Bayesian optimization has recently emerged as a popular and efficient tool for global optimization and hyperparameter tuning. Currently, the established Bayesian optimization practice requires a user-defined bounding box…

Bayesian OptimizationBenchmarkingglobal-optimization

Bayesian Optimization of Risk Measures

2020-07-10 · NeurIPS 2020 12 · Sait Cakmak, Raul Astudillo, Peter Frazier, Enlu Zhou

We consider Bayesian optimization of objective functions of the form $\rho[ F(x, W) ]$, where $F$ is a black-box expensive-to-evaluate function and $\rho$ denotes either the VaR or CVaR risk measure, computed with respec…

Bayesian OptimizationDecision MakingDecision Making Under UncertaintyPortfolio Optimization

Optimizing Conditional Value-At-Risk of Black-Box Functions

2021-12-01 · NeurIPS 2021 12 · Quoc Phong Nguyen, Zhongxiang Dai, Bryan Kian Hsiang Low, Patrick Jaillet

This paper presents two Bayesian optimization (BO) algorithms with theoretical performance guarantee to maximize the conditional value-at-risk (CVaR) of a black-box function: CV-UCB and CV-TS which are based on the well-…

Bayesian OptimizationThompson Sampling

Robust Multi-Objective Bayesian Optimization Under Input Noise

2022-02-15 · Samuel Daulton, Sait Cakmak, Maximilian Balandat, Michael A. Osborne 외

Bayesian optimization (BO) is a sample-efficient approach for tuning design parameters to optimize expensive-to-evaluate, black-box performance metrics. In many manufacturing processes, the design parameters are subject …

Bayesian Optimization