Bayesian Optimization using Deep Gaussian Processes
Bayesian Optimization using Gaussian Processes is a popular approach to deal with the optimization of expensive black-box functions. However, because of the a priori on the stationarity of the covariance matrix of classic Gaussian Processes, this method may not be adapted for non-stationary functions involved in the optimization problem. To overcome this issue, a new Bayesian Optimization approach is proposed. It is based on Deep Gaussian Processes as surrogate models instead of classic Gaussian Processes. This modeling technique increases the power of representation to capture the non-stationarity by simply considering a functional composition of stationary Gaussian Processes, providing a multiple layer structure. This paper proposes a new algorithm for Global Optimization by coupling Deep Gaussian Processes and Bayesian Optimization. The specificities of this optimization method are discussed and highlighted with academic test cases. The performance of the proposed algorithm is assessed on analytical test cases and an aerospace design optimization problem and compared to the state-of-the-art stationary and non-stationary Bayesian Optimization approaches.
Code (0)
등록된 구현이 없습니다.
Tasks
Bayesian OptimizationGaussian Processesglobal-optimizationSimilar Papers 제목 키워드 기반
Wasserstein Barycenter Gaussian Process based Bayesian Optimization
Gaussian Process based Bayesian Optimization is a widely applied algorithm to learn and optimize under uncertainty, well-known for its sample efficiency. However, recently -- and more frequently -- research studies have …
Bayesian OptimizationGaussian ProcessesFinancial Applications of Gaussian Processes and Bayesian Optimization
In the last five years, the financial industry has been impacted by the emergence of digitalization and machine learning. In this article, we explore two methods that have undergone rapid development in recent years: Gau…
Bayesian OptimizationBIG-bench Machine LearningGaussian Processesglobal-optimizationUpgrading from Gaussian Processes to Student's-T Processes
Gaussian process priors are commonly used in aerospace design for performing Bayesian optimization. Nonetheless, Gaussian processes suffer two significant drawbacks: outliers are a priori assumed unlikely, and the poster…
Bayesian OptimizationGaussian ProcessesExtrinsic Bayesian Optimizations on Manifolds
We propose an extrinsic Bayesian optimization (eBO) framework for general optimization problems on manifolds. Bayesian optimization algorithms build a surrogate of the objective function by employing Gaussian processes a…
Bayesian OptimizationGaussian ProcessesvalidQuantum Gaussian Process Regression for Bayesian Optimization
Gaussian process regression is a well-established Bayesian machine learning method. We propose a new approach to Gaussian process regression using quantum kernels based on parameterized quantum circuits. By employing a h…
Bayesian OptimizationGaussian ProcessesHyperparameter Optimizationregression