Stable Bayesian Optimisation via Direct Stability Quantification
In this paper we consider the problem of finding stable maxima of expensive (to evaluate) functions. We are motivated by the optimisation of physical and industrial processes where, for some input ranges, small and unavoidable variations in inputs lead to unacceptably large variation in outputs. Our approach uses multiple gradient Gaussian Process models to estimate the probability that worst-case output variation for specified input perturbation exceeded the desired maxima, and these probabilities are then used to (a) guide the optimisation process toward solutions satisfying our stability criteria and (b) post-filter results to find the best stable solution. We exhibit our algorithm on synthetic and real-world problems and demonstrate that it is able to effectively find stable maxima.
Code (0)
등록된 구현이 없습니다.
Tasks
Bayesian OptimisationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
GAUCHE: A Library for Gaussian Processes in Chemistry
We introduce GAUCHE, a library for GAUssian processes in CHEmistry. Gaussian processes have long been a cornerstone of probabilistic machine learning, affording particular advantages for uncertainty quantification and Ba…
Bayesian OptimisationGaussian ProcessesUncertainty QuantificationBayesian Physics Informed Neural Networks for Data Assimilation and Spatio-Temporal Modelling of Wildfires
We apply the Physics Informed Neural Network (PINN) to the problem of wildfire fire-front modelling. We use the PINN to solve the level-set equation, which is a partial differential equation that models a fire-front thro…
Uncertainty QuantificationSmooth Sequential Optimisation with Delayed Feedback
Stochastic delays in feedback lead to unstable sequential learning using multi-armed bandits. Recently, empirical Bayesian shrinkage has been shown to improve reward estimation in bandit learning. Here, we propose a nove…
Multi-Armed BanditsA Rigorous Link between Deep Ensembles and (Variational) Bayesian Methods
We establish the first mathematically rigorous link between Bayesian, variational Bayesian, and ensemble methods. A key step towards this it to reformulate the non-convex optimisation problem typically encountered in dee…
Deep LearningUncertainty QuantificationVariational InferenceBayesian Optimisation with Formal Guarantees
Application domains of Bayesian optimization include optimizing black-box functions or very complex functions. The functions we are interested in describe complex real-world systems applied in industrial settings. Even t…
Bayesian OptimisationBayesian Optimization