paper-with-me

홈 › Papers

Automating Bayesian optimization with Bayesian optimization

2018-12-01 · NeurIPS 2018 12 · Gustavo Malkomes, Roman Garnett

Bayesian optimization is a powerful tool for global optimization of expensive functions. One of its key components is the underlying probabilistic model used for the objective function f. In practice, however, it is often unclear how one should appropriately choose a model, especially when gathering data is expensive. In this work, we introduce a novel automated Bayesian optimization approach that dynamically selects promising models for explaining the observed data using Bayesian Optimization in the model space. Crucially, we account for the uncertainty in the choice of model; our method is capable of using multiple models to represent its current belief about f and subsequently using this information for decision making. We argue, and demonstrate empirically, that our approach automatically finds suitable models for the objective function, which ultimately results in more-efficient optimization.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

Bayesian OptimizationDecision Makingglobal-optimization

Similar Papers 제목 키워드 기반

Lifelong Bayesian Optimization

2019-05-29 · Yao Zhang, James Jordon, Ahmed M. Alaa, Mihaela van der Schaar

Automatic Machine Learning (Auto-ML) systems tackle the problem of automating the design of prediction models or pipelines for data science. In this paper, we present Lifelong Bayesian Optimization (LBO), an online, mult…

Bayesian OptimizationModel Selection

CATBench: A Compiler Autotuning Benchmarking Suite for Black-box Optimization

2024-06-24 · Jacob O. Tørring, Carl Hvarfner, Luigi Nardi, Magnus Själander

Bayesian optimization is a powerful method for automating tuning of compilers. The complex landscape of autotuning provides a myriad of rarely considered structural challenges for black-box optimizers, and the lack of st…

Bayesian OptimizationBenchmarkingCompiler Optimizationtensor algebra

Bayesian Optimization for Hyperparameters Tuning in Neural Networks

2024-10-29 · Gabriele Onorato

This study investigates the application of Bayesian Optimization (BO) for the hyperparameter tuning of neural networks, specifically targeting the enhancement of Convolutional Neural Networks (CNN) for image classificati…

Bayesian OptimizationComputational Efficiencyglobal-optimizationimage-classification+1

Efficient Controller Learning from Human Preferences and Numerical Data Via Multi-Modal Surrogate Models

2026-03-25 · Lukas Theiner, Maik Pfefferkorn, Yongpeng Zhao, Sebastian Hirt 외 arxiv

Tuning control policies manually to meet high-level objectives is often time-consuming. Bayesian optimization provides a data-efficient framework for automating this process using numerical evaluations of an objective fu…

LLaMEA-BO: A Large Language Model Evolutionary Algorithm for Automatically Generating Bayesian Optimization Algorithms

2025-05-27 · Wenhu Li, Niki van Stein, Thomas Bäck, Elena Raponi

Bayesian optimization (BO) is a powerful class of algorithms for optimizing expensive black-box functions, but designing effective BO algorithms remains a manual, expertise-driven task. Recent advancements in Large Langu…

Bayesian OptimizationBenchmarkingLanguage ModelingLanguage Modelling+2