BOSH: Bayesian Optimization by Sampling Hierarchically

2020-07-02 · Henry B. Moss, David S. Leslie, Paul Rayson

Deployments of Bayesian Optimization (BO) for functions with stochastic evaluations, such as parameter tuning via cross validation and simulation optimization, typically optimize an average of a fixed set of noisy realizations of the objective function. However, disregarding the true objective function in this manner finds a high-precision optimum of the wrong function. To solve this problem, we propose Bayesian Optimization by Sampling Hierarchically (BOSH), a novel BO routine pairing a hierarchical Gaussian process with an information-theoretic framework to generate a growing pool of realizations as the optimization progresses. We demonstrate that BOSH provides more efficient and higher-precision optimization than standard BO across synthetic benchmarks, simulation optimization, reinforcement learning and hyper-parameter tuning tasks.

📄 PDF Abstract BibTeX arXiv:2007.00939

Code (0)

등록된 구현이 없습니다.

Tasks

Bayesian Optimizationreinforcement-learning Reinforcement Learning (RL)

Methods 이 논문이 사용한 방법론

Gaussian Process Gaussian Processes are non-parametric models for approximating functions. They rely upon a measure of similarity between points (the kernel function) to predict the value for…

DEBOSH: Deep Bayesian Shape Optimization

2021-09-28 · Nikita Durasov, Artem Lukoyanov, Jonathan Donier, Pascal Fua

Graph Neural Networks (GNNs) can predict the performance of an industrial design quickly and accurately and be used to optimize its shape effectively. However, to fully explore the shape space, one must often consider sh…

Bayesian Optimization Gaussian Processes

BOSH: An Efficient Meta Algorithm for Decision-based Attacks

2019-09-10 · Zhenxin Xiao, Puyudi Yang, Yuchen Jiang, Kai-Wei Chang 외

Adversarial example generation becomes a viable method for evaluating the robustness of a machine learning model. In this paper, we consider hard-label black-box attacks (a.k.a. decision-based attacks), which is a challe…

Adversarial Attack Bayesian Optimization

Exploring Bayesian Models for Multi-level Clustering of Hierarchically Grouped Sequential Data

2015-04-19 · Adway Mitra

A wide range of Bayesian models have been proposed for data that is divided hierarchically into groups. These models aim to cluster the data at different levels of grouping, by assigning a mixture component to each datap…

Clustering

Scalable Bayesian Optimization via Focalized Sparse Gaussian Processes

2024-12-29 · Yunyue Wei, Vincent Zhuang, Saraswati Soedarmadji, Yanan Sui

Bayesian optimization is an effective technique for black-box optimization, but its applicability is typically limited to low-dimensional and small-budget problems due to the cubic complexity of computing the Gaussian pr…