paper-with-me

Papers

Efficient Batch Black-box Optimization with Deterministic Regret Bounds

2019-05-24 · Yueming Lyu, Yuan Yuan, Ivor W. Tsang

In this work, we investigate black-box optimization from the perspective of frequentist kernel methods. We propose a novel batch optimization algorithm, which jointly maximizes the acquisition function and select points from a whole batch in a holistic way. Theoretically, we derive regret bounds for both the noise-free and perturbation settings irrespective of the choice of kernel. Moreover, we analyze the property of the adversarial regret that is required by a robust initialization for Bayesian Optimization (BO). We prove that the adversarial regret bounds decrease with the decrease of covering radius, which provides a criterion for generating a point set to minimize the bound. We then propose fast searching algorithms to generate a point set with a small covering radius for the robust initialization. Experimental results on both synthetic benchmark problems and real-world problems show the effectiveness of the proposed algorithms.

📄 PDF Abstract BibTeX arXiv:1905.10041

Code (0)

등록된 구현이 없습니다.

Tasks

Bayesian Optimization

Similar Papers 제목 키워드 기반

Batched Kernelized Bandits: Refinements and Extensions

2026-03-13 · Chenkai Ma, Keqin Chen, Jonathan Scarlett arxiv

In this paper, we consider the problem of black-box optimization with noisy feedback revealed in batches, where the unknown function to optimize has a bounded norm in some Reproducing Kernel Hilbert Space (RKHS). We refe…

Gaussian Process Bandit Optimization with Few Batches

2021-10-15 · Zihan Li, Jonathan Scarlett

In this paper, we consider the problem of black-box optimization using Gaussian Process (GP) bandit optimization with a small number of batches. Assuming the unknown function has a low norm in the Reproducing Kernel Hilb…

Diversified Sampling for Batched Bayesian Optimization with Determinantal Point Processes

2021-10-22 · Elvis Nava, Mojmír Mutný, Andreas Krause

In Bayesian Optimization (BO) we study black-box function optimization with noisy point evaluations and Bayesian priors. Convergence of BO can be greatly sped up by batching, where multiple evaluations of the black-box f…

Bayesian OptimizationDiversityPoint ProcessesThompson Sampling

Improved Regret Analysis for Parallel Gaussian Process Bandit Optimization

2026-08-17 · Shion Takeno, Shogo Iwazaki arxiv

This paper studies the regret analysis for parallel Gaussian process (GP) bandit optimization. The known regret upper bounds for the widely used GP batched upper confidence bound and GP batched Thompson sampling (GP-BTS)…

Distributed Batch Gaussian Process Optimization

2017-08-01 · ICML 2017 8 · Erik A. Daxberger, Bryan Kian Hsiang Low

This paper presents a novel distributed batch Gaussian process upper confidence bound (DB-GP-UCB) algorithm for performing batch Bayesian optimization (BO) of highly complex, costly-to-evaluate black-box objective f…

Bayesian Optimization