paper-with-me

Papers

Heteroscedastic Treed Bayesian Optimisation

2014-10-27 · John-Alexander M. Assael, Ziyu Wang, Bobak Shahriari, Nando de Freitas

Optimising black-box functions is important in many disciplines, such as tuning machine learning models, robotics, finance and mining exploration. Bayesian optimisation is a state-of-the-art technique for the global optimisation of black-box functions which are expensive to evaluate. At the core of this approach is a Gaussian process prior that captures our belief about the distribution over functions. However, in many cases a single Gaussian process is not flexible enough to capture non-stationarity in the objective function. Consequently, heteroscedasticity negatively affects performance of traditional Bayesian methods. In this paper, we propose a novel prior model with hierarchical parameter learning that tackles the problem of non-stationarity in Bayesian optimisation. Our results demonstrate substantial improvements in a wide range of applications, including automatic machine learning and mining exploration.

📄 PDF Abstract BibTeX arXiv:1410.7172

Code (0)

등록된 구현이 없습니다.

Tasks

Bayesian OptimisationBIG-bench Machine Learning

Methods 이 논문이 사용한 방법론

Gaussian Process Gaussian Processes are non-parametric models for approximating functions. They rely upon a measure of similarity between points (the kernel function) to predict the value for…

Similar Papers 제목 키워드 기반

Achieving Robustness to Aleatoric Uncertainty with Heteroscedastic Bayesian Optimisation

2019-10-17 · Ryan-Rhys Griffiths, Alexander A. Aldrick, Miguel Garcia-Ortegon, Vidhi R. Lalchand 외

Bayesian optimisation is a sample-efficient search methodology that holds great promise for accelerating drug and materials discovery programs. A frequently-overlooked modelling consideration in Bayesian optimisation str…

Bayesian OptimisationDecision MakingDrug Discovery

Antifragile and Robust Heteroscedastic Bayesian Optimisation

2019-09-25 · Ryan Rhys-Griffiths, Miguel Garcia-Ortegon, Alexander A. Aldrick, Alpha A. Lee

Bayesian Optimisation is an important decision-making tool for high-stakes applications in drug discovery and materials design. An oft-overlooked modelling consideration however is the representation of input-depende…

Bayesian OptimisationDecision MakingDrug Discovery

HEBO Pushing The Limits of Sample-Efficient Hyperparameter Optimisation

2020-12-07 · Alexander I. Cowen-Rivers, Wenlong Lyu, Rasul Tutunov, Zhi Wang 외

In this work we rigorously analyse assumptions inherent to black-box optimisation hyper-parameter tuning tasks. Our results on the Bayesmark benchmark indicate that heteroscedasticity and non-stationarity pose significan…

Bayesian OptimisationBIG-bench Machine LearningHyperparameter Optimization

Bayesian Quantile and Expectile Optimisation

2020-01-12 · Victor Picheny, Henry Moss, Léonard Torossian, Nicolas Durrande

Bayesian optimisation (BO) is widely used to optimise stochastic black box functions. While most BO approaches focus on optimising conditional expectations, many applications require risk-averse strategies and alternativ…

Bayesian OptimisationGaussian ProcessesThompson Sampling

Heteroscedastic Bayesian Optimisation for Stochastic Model Predictive Control

2020-10-01 · Rel Guzman, Rafael Oliveira, Fabio Ramos

Model predictive control (MPC) has been successful in applications involving the control of complex physical systems. This class of controllers leverages the information provided by an approximate model of the system's d…

Bayesian Optimisationcontinuous-controlContinuous Controlmodel+1