Data-driven Prior Learning for Bayesian Optimisation
Transfer learning for Bayesian optimisation has generally assumed a strong similarity between optimisation tasks, with at least a subset having similar optimal inputs. This assumption can reduce computational costs, but it is violated in a wide range of optimisation problems where transfer learning may nonetheless be useful. We replace this assumption with a weaker one only requiring the shape of the optimisation landscape to be similar, and analyse the recent method Prior Learning for Bayesian Optimisation - PLeBO - in this setting. By learning priors for the hyperparameters of the Gaussian process surrogate model we can better approximate the underlying function, especially for few function evaluations. We validate the learned priors and compare to a breadth of transfer learning approaches, using synthetic data and a recent air pollution optimisation problem as benchmarks. We show that PLeBO and prior transfer find good inputs in fewer evaluations.
Code (1)
Tasks
Bayesian OptimisationTransfer LearningMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Natural Evolutionary Search meets Probabilistic Numerics
Zeroth-order local optimisation algorithms are essential for solving real-valued black-box optimisation problems. Among these, Natural Evolution Strategies (NES) represent a prominent class, particularly well-suited for …
Incorporating Expert Prior in Bayesian Optimisation via Space Warping
Bayesian optimisation is a well-known sample-efficient method for the optimisation of expensive black-box functions. However when dealing with big search spaces the algorithm goes through several low function value regio…
Bayesian OptimisationHeteroscedastic Treed Bayesian Optimisation
Optimising black-box functions is important in many disciplines, such as tuning machine learning models, robotics, finance and mining exploration. Bayesian optimisation is a state-of-the-art technique for the global opti…
Bayesian OptimisationBIG-bench Machine LearningBayesian functional optimisation with shape prior
Real world experiments are expensive, and thus it is important to reach a target in minimum number of experiments. Experimental processes often involve control variables that changes over time. Such problems can be formu…
Bayesian OptimisationShaping of Magnetic Field Coils in Fusion Reactors using Bayesian Optimisation
Nuclear fusion using magnetic confinement holds promise as a viable method for sustainable energy. However, most fusion devices have been experimental and as we move towards energy reactors, we are entering into a new pa…
Bayesian Optimisation