Explainable Learning with Gaussian Processes
The field of explainable artificial intelligence (XAI) attempts to develop methods that provide insight into how complicated machine learning methods make predictions. Many methods of explanation have focused on the concept of feature attribution, a decomposition of the model's prediction into individual contributions corresponding to each input feature. In this work, we explore the problem of feature attribution in the context of Gaussian process regression (GPR). We take a principled approach to defining attributions under model uncertainty, extending the existing literature. We show that although GPR is a highly flexible and non-parametric approach, we can derive interpretable, closed-form expressions for the feature attributions. When using integrated gradients as an attribution method, we show that the attributions of a GPR model also follow a Gaussian process distribution, which quantifies the uncertainty in attribution arising from uncertainty in the model. We demonstrate, both through theory and experimentation, the versatility and robustness of this approach. We also show that, when applicable, the exact expressions for GPR attributions are both more accurate and less computationally expensive than the approximations currently used in practice. The source code for this project is freely available under MIT license at https://github.com/KurtButler/2024_attributions_paper.
Code (1)
Tasks
Explainable artificial intelligenceExplainable Artificial Intelligence (XAI)Gaussian ProcessesGPRMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Integrated Gradient attribution for Gaussian Processes with non-Gaussian likelihoods
Gaussian Processes (GPs) have proven themselves as a reliable and effective method in probabilistic machine learning. Thanks to recent and current advances, modelling complex data with GPs is becoming more and more feasi…
BIG-bench Machine LearningGaussian ProcessesregressionDeep Feature Gaussian Processes for Single-Scene Aerosol Optical Depth Reconstruction
Remote sensing data provide a low-cost solution for large-scale monitoring of air pollution via the retrieval of aerosol optical depth (AOD), but is often limited by cloud contamination. Existing methods for AOD reconstr…
Gaussian ProcessesRepresentation LearningLatent Map Gaussian Processes for Mixed Variable Metamodeling
Gaussian processes (GPs) are ubiquitously used in sciences and engineering as metamodels. Standard GPs, however, can only handle numerical or quantitative variables. In this paper, we introduce latent map Gaussian proces…
Bayesian OptimizationGaussian ProcessesNetwork InterpretationKernel Learning for Explainable Climate Science
The Upper Indus Basin, Himalayas provides water for 270 million people and countless ecosystems. However, precipitation, a key component to hydrological modelling, is poorly understood in this area. A key challenge surro…
Gaussian ProcessesUpgrading from Gaussian Processes to Student's-T Processes
Gaussian process priors are commonly used in aerospace design for performing Bayesian optimization. Nonetheless, Gaussian processes suffer two significant drawbacks: outliers are a priori assumed unlikely, and the poster…
Bayesian OptimizationGaussian Processes