paper-with-me

홈 › Papers

MUMBO: MUlti-task Max-value Bayesian Optimization

2020-06-22 · Henry B. Moss, David S. Leslie, Paul Rayson

We propose MUMBO, the first high-performing yet computationally efficient acquisition function for multi-task Bayesian optimization. Here, the challenge is to perform efficient optimization by evaluating low-cost functions somehow related to our true target function. This is a broad class of problems including the popular task of multi-fidelity optimization. However, while information-theoretic acquisition functions are known to provide state-of-the-art Bayesian optimization, existing implementations for multi-task scenarios have prohibitive computational requirements. Previous acquisition functions have therefore been suitable only for problems with both low-dimensional parameter spaces and function query costs sufficiently large to overshadow very significant optimization overheads. In this work, we derive a novel multi-task version of entropy search, delivering robust performance with low computational overheads across classic optimization challenges and multi-task hyper-parameter tuning. MUMBO is scalable and efficient, allowing multi-task Bayesian optimization to be deployed in problems with rich parameter and fidelity spaces.

📄 PDF Abstract BibTeX arXiv:2006.12093

Code (0)

등록된 구현이 없습니다.

Tasks

Bayesian Optimization

Similar Papers 제목 키워드 기반

Safe Bayesian Optimization for Uncertain Correlation Matrices in Linear Models of Co-Regionalization

2026-05-13 · Jannis Lübsen, Annika Eichler arxiv

This paper extends safety guarantees for multi-task Bayesian optimization with uncertain co-regionalization matrices from intrinsic co-regionalization models to linear models of co-regionalization. The latter allows for …

Bayesian task embedding for few-shot Bayesian optimization

2020-01-02 · Steven Atkinson, Sayan Ghosh, Natarajan Chennimalai-Kumar, Genghis Khan 외

We describe a method for Bayesian optimization by which one may incorporate data from multiple systems whose quantitative interrelationships are unknown a priori. All general (nonreal-valued) features of the systems are …

Bayesian InferenceBayesian Optimization

No-regret Algorithms for Multi-task Bayesian Optimization

2020-08-20 · Sayak Ray Chowdhury, Aditya Gopalan

We consider multi-objective optimization (MOO) of an unknown vector-valued function in the non-parametric Bayesian optimization (BO) setting, with the aim being to learn points on the Pareto front of the objectives. Most…

Bayesian Optimization

Bayesian Joint Chance Constrained Optimization: Approximations and Statistical Consistency

2021-06-23 · Prateek Jaiswal, Harsha Honnappa, Vinayak A. Rao

This paper considers data-driven chance-constrained stochastic optimization problems in a Bayesian framework. Bayesian posteriors afford a principled mechanism to incorporate data and prior knowledge into stochastic opti…

Stochastic Optimization

Scalable Bayesian Optimization Using Vecchia Approximations of Gaussian Processes

2022-03-02 · Felix Jimenez, Matthias Katzfuss

Bayesian optimization is a technique for optimizing black-box target functions. At the core of Bayesian optimization is a surrogate model that predicts the output of the target function at previously unseen inputs to fac…

Bayesian OptimizationGaussian ProcessesThompson Sampling