paper-with-me

홈 › Papers

Transfer Learning for Bayesian Optimization: A Survey

2023-02-12 · Tianyi Bai, Yang Li, Yu Shen, Xinyi Zhang, Wentao Zhang, Bin Cui

A wide spectrum of design and decision problems, including parameter tuning, A/B testing and drug design, intrinsically are instances of black-box optimization. Bayesian optimization (BO) is a powerful tool that models and optimizes such expensive "black-box" functions. However, at the beginning of optimization, vanilla Bayesian optimization methods often suffer from slow convergence issue due to inaccurate modeling based on few trials. To address this issue, researchers in the BO community propose to incorporate the spirit of transfer learning to accelerate optimization process, which could borrow strength from the past tasks (source tasks) to accelerate the current optimization problem (target task). This survey paper first summarizes transfer learning methods for Bayesian optimization from four perspectives: initial points design, search space design, surrogate model, and acquisition function. Then it highlights its methodological aspects and technical details for each approach. Finally, it showcases a wide range of applications and proposes promising future directions.

📄 PDF Abstract BibTeX arXiv:2302.05927

Code (0)

등록된 구현이 없습니다.

Tasks

Bayesian OptimizationDrug DesignSurveyTransfer Learning

Similar Papers 제목 키워드 기반

Bayesian Optimization -- Multi-Armed Bandit Problem

2020-12-14 · Abhilash Nandy, Chandan Kumar, Deepak Mewada, Soumya Sharma

In this report, we survey Bayesian Optimization methods focussed on the Multi-Armed Bandit Problem. We take the help of the paper "Portfolio Allocation for Bayesian Optimization". We report a small literature survey on t…

Bayesian OptimizationSurvey

Bayesian Transfer Learning

2023-12-20 · Piotr M. Suder, Jason Xu, David B. Dunson

Transfer learning is a burgeoning concept in statistical machine learning that seeks to improve inference and/or predictive accuracy on a domain of interest by leveraging data from related domains. While the term "transf…

Electrical EngineeringTransfer Learning

Practical Transfer Learning for Bayesian Optimization

2018-02-06 · Matthias Feurer, Benjamin Letham, Frank Hutter, Eytan Bakshy

When hyperparameter optimization of a machine learning algorithm is repeated for multiple datasets it is possible to transfer knowledge to an optimization run on a new dataset. We develop a new hyperparameter-free ensemb…

Bayesian OptimizationGaussian ProcessesHyperparameter OptimizationMeta-Learning+1

Bayesian Optimization in Materials Science: A Survey

2021-07-29 · Lars Kotthoff, Hud Wahab, Patrick Johnson

Bayesian optimization is used in many areas of AI for the optimization of black-box processes and has achieved impressive improvements of the state of the art for a lot of applications. It intelligently explores large an…

Bayesian OptimizationSurvey

A survey and benchmark of high-dimensional Bayesian optimization of discrete sequences

2024-06-07 · Miguel González-Duque, Richard Michael, Simon Bartels, Yevgen Zainchkovskyy 외

Optimizing discrete black-box functions is key in several domains, e.g. protein engineering and drug design. Due to the lack of gradient information and the need for sample efficiency, Bayesian optimization is an ideal c…

Bayesian OptimizationDrug Design