Towards safe Bayesian optimization with Wiener kernel regression
Bayesian Optimization (BO) is a data-driven strategy for minimizing/maximizing black-box functions based on probabilistic surrogate models. In the presence of safety constraints, the performance of BO crucially relies on tight probabilistic error bounds related to the uncertainty surrounding the surrogate model. For the case of Gaussian Process surrogates and Gaussian measurement noise, we present a novel error bound based on the recently proposed Wiener kernel regression. We prove that under rather mild assumptions, the proposed error bound is tighter than bounds previously documented in the literature, leading to enlarged safety regions. We draw upon a numerical example to demonstrate the efficacy of the proposed error bound in safe BO.
Code (1)
Tasks
Bayesian OptimizationregressionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Wiener Chaos in Kernel Regression: Towards Untangling Aleatoric and Epistemic Uncertainty
Gaussian Processes (GPs) are a versatile method that enables different approaches towards learning for dynamics and control. Gaussianity assumptions appear in two dimensions in GPs: The positive semi-definite kernel of t…
Gaussian ProcessesregressionThe Functional Wiener Filter
This paper presents a close form solution in Reproducing Kernel Hilbert Space (RKHS) for the famed Wiener filter, which we called the functional Wiener filter(FWF). Instead of using the Wiener-Hopf factorization theory, …
Time SeriesTime Series AnalysisBayesian Optimization by Kernel Regression and Density-based Exploration
Bayesian optimization is highly effective for optimizing expensive-to-evaluate black-box functions, but it faces significant computational challenges due to the high computational complexity of Gaussian processes, which …
Bayesian OptimizationComputational EfficiencyGaussian ProcessesregressionNonparametric, Nonasymptotic Confidence Bands with Paley-Wiener Kernels for Band-Limited Functions
The paper introduces a method to construct confidence bands for bounded, band-limited functions based on a finite sample of input-output pairs. The approach is distribution-free w.r.t. the observation noises and only the…
An Analytic Solution for Kernel Adaptive Filtering
Conventional kernel adaptive filtering (KAF) uses a prescribed, positive definite, nonlinear function to define the Reproducing Kernel Hilbert Space (RKHS), where the optimal solution for mean square error estimation is …