Gaussian Process Uniform Error Bounds with Unknown Hyperparameters for Safety-Critical Applications
Gaussian processes have become a promising tool for various safety-critical settings, since the posterior variance can be used to directly estimate the model error and quantify risk. However, state-of-the-art techniques for safety-critical settings hinge on the assumption that the kernel hyperparameters are known, which does not apply in general. To mitigate this, we introduce robust Gaussian process uniform error bounds in settings with unknown hyperparameters. Our approach computes a confidence region in the space of hyperparameters, which enables us to obtain a probabilistic upper bound for the model error of a Gaussian process with arbitrary hyperparameters. We do not require to know any bounds for the hyperparameters a priori, which is an assumption commonly found in related work. Instead, we are able to derive bounds from data in an intuitive fashion. We additionally employ the proposed technique to derive performance guarantees for a class of learning-based control problems. Experiments show that the bound performs significantly better than vanilla and fully Bayesian Gaussian processes.
Code (1)
Tasks
Gaussian ProcessesMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Uniform Error Bounds for Gaussian Process Regression with Application to Safe Control
Data-driven models are subject to model errors due to limited and noisy training data. Key to the application of such models in safety-critical domains is the quantification of their model error. Gaussian processes provi…
Gaussian ProcessesregressionUniform Error and Posterior Variance Bounds for Gaussian Process Regression with Application to Safe Control
In application areas where data generation is expensive, Gaussian processes are a preferred supervised learning model due to their high data-efficiency. Particularly in model-based control, Gaussian processes allow the d…
Gaussian ProcessesregressionActive Target Tracking Using Bearing-only Measurements With Gaussian Process Learning
This paper studies the tracking problem of a target with the partially unknown motion model by an active agent with bearing-only measurements using Gaussian process learning. To address this problem, a learning-planning-…
On Uniform Error Bounds for Kernel Regression under Non-Gaussian Noise
Providing non-conservative uncertainty quantification for function estimates derived from noisy observations remains a fundamental challenge in statistical machine learning, particularly for applications in safety-critic…
On Least Squares Estimation under Heteroscedastic and Heavy-Tailed Errors
We consider least squares estimation in a general nonparametric regression model. The rate of convergence of the least squares estimator (LSE) for the unknown regression function is well studied when the errors are sub-G…
regression