paper-with-me

Papers

Bayesian Optimization of Function Networks with Partial Evaluations

2023-11-03 · Poompol Buathong, Jiayue Wan, Raul Astudillo, Samuel Daulton, Maximilian Balandat, Peter I. Frazier

Bayesian optimization is a powerful framework for optimizing functions that are expensive or time-consuming to evaluate. Recent work has considered Bayesian optimization of function networks (BOFN), where the objective function is given by a network of functions, each taking as input the output of previous nodes in the network as well as additional parameters. Leveraging this network structure has been shown to yield significant performance improvements. Existing BOFN algorithms for general-purpose networks evaluate the full network at each iteration. However, many real-world applications allow for evaluating nodes individually. To exploit this, we propose a novel knowledge gradient acquisition function that chooses which node and corresponding inputs to evaluate in a cost-aware manner, thereby reducing query costs by evaluating only on a part of the network at each step. We provide an efficient approach to optimizing our acquisition function and show that it outperforms existing BOFN methods and other benchmarks across several synthetic and real-world problems. Our acquisition function is the first to enable cost-aware optimization of a broad class of function networks.

📄 PDF Abstract BibTeX arXiv:2311.02146

Code (1)

frazier-lab/partial_kgfn 공식 구현 pytorch

Tasks

Bayesian Optimization

Similar Papers 제목 키워드 기반

Fast Bayesian Optimization of Function Networks with Partial Evaluations

2025-06-13 · Poompol Buathong, Peter I. Frazier

Bayesian optimization of function networks (BOFN) is a framework for optimizing expensive-to-evaluate objective functions structured as networks, where some nodes' outputs serve as inputs for others. Many real-world appl…

Bayesian OptimizationDrug Discovery

Bayesian Optimization With Censored Response Data

2013-10-07 · Frank Hutter, Holger Hoos, Kevin Leyton-Brown

Bayesian optimization (BO) aims to minimize a given blackbox function using a model that is updated whenever new evidence about the function becomes available. Here, we address the problem of BO under partially right-cen…

Bayesian Optimization

A General Framework for Constrained Bayesian Optimization using Information-based Search

2015-11-30 · José Miguel Hernández-Lobato, Michael A. Gelbart, Ryan P. Adams, Matthew W. Hoffman 외

We present an information-theoretic framework for solving global black-box optimization problems that also have black-box constraints. Of particular interest to us is to efficiently solve problems with decoupled constrai…

Bayesian OptimizationCPUGPU

A Tutorial on Bayesian Optimization

2018-07-08 · Peter I. Frazier

Bayesian optimization is an approach to optimizing objective functions that take a long time (minutes or hours) to evaluate. It is best-suited for optimization over continuous domains of less than 20 dimensions, and tole…

Bayesian OptimizationHyperparameter Optimizationregression

Multiple Adaptive Bayesian Linear Regression for Scalable Bayesian Optimization with Warm Start

2017-12-08 · Valerio Perrone, Rodolphe Jenatton, Matthias Seeger, Cedric Archambeau

Bayesian optimization (BO) is a model-based approach for gradient-free black-box function optimization. Typically, BO is powered by a Gaussian process (GP), whose algorithmic complexity is cubic in the number of evaluati…

Bayesian OptimizationBIG-bench Machine Learningregression