paper-with-me

홈 › Papers

Knowing The What But Not The Where in Bayesian Optimization

2019-05-07 · ICML 2020 1 · Vu Nguyen, Michael A. Osborne

Bayesian optimization has demonstrated impressive success in finding the optimum input x* and output f* = f(x*) = max f(x) of a black-box function f. In some applications, however, the optimum output f* is known in advance and the goal is to find the corresponding optimum input x*. In this paper, we consider a new setting in BO in which the knowledge of the optimum output f* is available. Our goal is to exploit the knowledge about f* to search for the input x* efficiently. To achieve this goal, we first transform the Gaussian process surrogate using the information about the optimum output. Then, we propose two acquisition functions, called confidence bound minimization and expected regret minimization. We show that our approaches work intuitively and give quantitatively better performance against standard BO methods. We demonstrate real applications in tuning a deep reinforcement learning algorithm on the CartPole problem and XGBoost on Skin Segmentation dataset in which the optimum values are publicly available.

📄 PDF Abstract BibTeX arXiv:1905.02685

Code (1)

ntienvu/KnownOptimum_BO 공식 구현

Tasks

Bayesian OptimizationDeep Reinforcement LearningReinforcement Learning

Methods 이 논문이 사용한 방법론

Gaussian Process Gaussian Processes are non-parametric models for approximating functions. They rely upon a measure of similarity between points (the kernel function) to predict the value for…

Similar Papers 제목 키워드 기반

Learning When to Optimize: Verified Optimization Skills from Expert GPU-Kernel Lineages

2026-05-27 · Shuoming Zhang, Qiuchu Yu, Yangyu Zhang, Ruiyuan Xu 외 arxiv

LLM-based agents are increasingly used to generate GPU kernels, but they often know what optimizations to try without knowing when those optimizations are sound. We introduce KLineage, which learns this missing "when" kn…

Causal Bayesian Optimization

2020-05-24 · Virginia Aglietti, Xiaoyu Lu, Andrei Paleyes, Javier González

This paper studies the problem of globally optimizing a variable of interest that is part of a causal model in which a sequence of interventions can be performed. This problem arises in biology, operational research, com…

Bayesian OptimizationCausal InferenceDecision MakingSequential Decision Making+1

Solving Black-Box Optimization Challenge via Learning Search Space Partition for Local Bayesian Optimization

2020-12-18 · Mikita Sazanovich, Anastasiya Nikolskaya, Yury Belousov, Aleksei Shpilman

Black-box optimization is one of the vital tasks in machine learning, since it approximates real-world conditions, in that we do not always know all the properties of a given system, up to knowing almost nothing but the …

Bayesian Optimization

Beyond knowing that: a new generation of epistemic logics

2016-05-06 · Yanjing Wang

Epistemic logic has become a major field of philosophical logic ever since the groundbreaking work by Hintikka (1962). Despite its various successful applications in theoretical computer science, AI, and game theory, the…

Survey

High Dimensional Bayesian Optimization via Supervised Dimension Reduction

2019-07-21 · Miao Zhang, Huiqi Li, Steven Su

Bayesian optimization (BO) has been broadly applied to computational expensive problems, but it is still challenging to extend BO to high dimensions. Existing works are usually under strict assumption of an additive or a…

Bayesian OptimizationDimensionality ReductionVocal Bursts Intensity Prediction