Can local explanation techniques explain linear additive models?
Local model-agnostic additive explanation techniques decompose the predicted output of a black-box model into additive feature importance scores. Questions have been raised about the accuracy of the produced local additive explanations. We investigate this by studying whether some of the most popular explanation techniques can accurately explain the decisions of linear additive models. We show that even though the explanations generated by these techniques are linear additives, they can fail to provide accurate explanations when explaining linear additive models. In the experiments, we measure the accuracy of additive explanations, as produced by, e.g., LIME and SHAP, along with the non-additive explanations of Local Permutation Importance (LPI) when explaining Linear and Logistic Regression and Gaussian naive Bayes models over 40 tabular datasets. We also investigate the degree to which different factors, such as the number of numerical or categorical or correlated features, the predictive performance of the black-box model, explanation sample size, similarity metric, and the pre-processing technique used on the dataset can directly affect the accuracy of local explanations.
Code (1)
Tasks
Additive modelsExplanation Fidelity EvaluationFeature ImportanceMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Evaluating Local Explanations using White-box Models
Evaluating explanation techniques using human subjects is costly, time-consuming and can lead to subjectivity in the assessments. To evaluate the accuracy of local explanations, we require access to the true feature impo…
Feature ImportanceConsiderations When Learning Additive Explanations for Black-Box Models
Many methods to explain black-box models, whether local or global, are additive. In this paper, we study global additive explanations for non-additive models, focusing on four explanation methods: partial dependence, Sha…
Additive modelsSurvNAM: The machine learning survival model explanation
A new modification of the Neural Additive Model (NAM) called SurvNAM and its modifications are proposed to explain predictions of the black-box machine learning survival model. The method is based on applying the origina…
BIG-bench Machine LearningmodelSurvival AnalysisInstance-based Explanations for Gradient Boosting Machine Predictions with AXIL Weights
We show that regression predictions from linear and tree-based models can be represented as linear combinations of target instances in the training data. This also holds for models constructed as ensembles of trees, incl…
Feature ImportanceregressionEvaluating Local Explainability Metrics for Machine Learning Models on Tabular Data
Despite the wide use of explainability techniques to attempt to understand the behavior of Artificial Intelligence (AI), the generated explanations may not always be reliable. An explanation can appear plausible to human…