paper-with-me

홈 › Papers

Random Exploration in Bayesian Optimization: Order-Optimal Regret and Computational Efficiency

2023-10-23 · Sudeep Salgia, Sattar Vakili, Qing Zhao

We consider Bayesian optimization using Gaussian Process models, also referred to as kernel-based bandit optimization. We study the methodology of exploring the domain using random samples drawn from a distribution. We show that this random exploration approach achieves the optimal error rates. Our analysis is based on novel concentration bounds in an infinite dimensional Hilbert space established in this work, which may be of independent interest. We further develop an algorithm based on random exploration with domain shrinking and establish its order-optimal regret guarantees under both noise-free and noisy settings. In the noise-free setting, our analysis closes the existing gap in regret performance and thereby resolves a COLT open problem. The proposed algorithm also enjoys a computational advantage over prevailing methods due to the random exploration that obviates the expensive optimization of a non-convex acquisition function for choosing the query points at each iteration.

📄 PDF Abstract BibTeX arXiv:2310.15351

Code (0)

등록된 구현이 없습니다.

Tasks

Bayesian OptimizationComputational Efficiency

Methods 이 논문이 사용한 방법론

Gaussian Process Gaussian Processes are non-parametric models for approximating functions. They rely upon a measure of similarity between points (the kernel function) to predict the value for…

Similar Papers 제목 키워드 기반

Enhancing Gaussian Process Surrogates for Optimization and Posterior Approximation via Random Exploration

2024-01-30 · Hwanwoo Kim, Daniel Sanz-Alonso

This paper proposes novel noise-free Bayesian optimization strategies that rely on a random exploration step to enhance the accuracy of Gaussian process surrogate models. The new algorithms retain the ease of implementat…

Bayesian InferenceBayesian Optimization

Bayesian Optimization for Unknown Cost-Varying Variable Subsets with No-Regret Costs

2024-12-20 · Vu Viet Hoang, Quoc Anh Hoang Nguyen, Hung Tran The

Bayesian Optimization (BO) is a widely-used method for optimizing expensive-to-evaluate black-box functions. Traditional BO assumes that the learner has full control over all query variables without additional constraint…

Bayesian Optimization

Topological Bayesian Optimization with Persistence Diagrams

2019-02-26 · Tatsuya Shiraishi, Tam Le, Hisashi Kashima, Makoto Yamada

Finding an optimal parameter of a black-box function is important for searching stable material structures and finding optimal neural network structures, and Bayesian optimization algorithms are widely used for the purpo…

Bayesian OptimizationTopological Data Analysis

Hyperband: A Novel Bandit-Based Approach to Hyperparameter Optimization

2016-03-21 · Lisha Li, Kevin Jamieson, Giulia Desalvo, Afshin Rostamizadeh 외

Performance of machine learning algorithms depends critically on identifying a good set of hyperparameters. While recent approaches use Bayesian optimization to adaptively select configurations, we focus on speeding up r…

Bayesian OptimizationHyperparameter Optimization

Preparation of ordered states in ultra-cold gases using Bayesian optimization

2020-01-10 · Rick Mukherjee, Frederic Sauvage, Harry Xie, Robert Löw 외

Ultra-cold atomic gases are unique in terms of the degree of controllability, both for internal and external degrees of freedom. This makes it possible to use them for the study of complex quantum many-body phenomena. Ho…

Bayesian Optimization