Bayesian functional optimisation with shape prior
Real world experiments are expensive, and thus it is important to reach a target in minimum number of experiments. Experimental processes often involve control variables that changes over time. Such problems can be formulated as a functional optimisation problem. We develop a novel Bayesian optimisation framework for such functional optimisation of expensive black-box processes. We represent the control function using Bernstein polynomial basis and optimise in the coefficient space. We derive the theory and practice required to dynamically adjust the order of the polynomial degree, and show how prior information about shape can be integrated. We demonstrate the effectiveness of our approach for short polymer fibre design and optimising learning rate schedules for deep networks.
Code (0)
등록된 구현이 없습니다.
Tasks
Bayesian OptimisationSimilar Papers 제목 키워드 기반
Data-driven Prior Learning for Bayesian Optimisation
Transfer learning for Bayesian optimisation has generally assumed a strong similarity between optimisation tasks, with at least a subset having similar optimal inputs. This assumption can reduce computational costs, but …
Bayesian OptimisationTransfer LearningFunctional BART with Shape Priors: A Bayesian Tree Approach to Constrained Functional Regression
Motivated by the remarkable success of Bayesian additive regression trees (BART) in regression modelling, we propose a novel nonparametric Bayesian method, termed Functional BART (FBART), tailored specifically for functi…
regressionSequential Subspace Search for Functional Bayesian Optimization Incorporating Experimenter Intuition
We propose an algorithm for Bayesian functional optimisation - that is, finding the function to optimise a process - guided by experimenter beliefs and intuitions regarding the expected characteristics (length-scale, smo…
Bayesian OptimisationBayesian OptimizationIntrinsic Bayesian Optimisation on Complex Constrained Domain
Motivated by the success of Bayesian optimisation algorithms in the Euclidean space, we propose a novel approach to construct Intrinsic Bayesian optimisation (In-BO) on manifolds with a primary focus on complex constrain…
Bayesian OptimisationGaussian ProcessesIncorporating Expert Prior in Bayesian Optimisation via Space Warping
Bayesian optimisation is a well-known sample-efficient method for the optimisation of expensive black-box functions. However when dealing with big search spaces the algorithm goes through several low function value regio…
Bayesian Optimisation