paper-with-me

홈 › Papers

Can local explanation techniques explain linear additive models?

2023-09-19 · Data Mining and Knowledge Discovery 2023 9 · Amir Hossein Akhavan Rahnama, Judith Bütepage, Pierre Geurts, Henrik Boström

Local model-agnostic additive explanation techniques decompose the predicted output of a black-box model into additive feature importance scores. Questions have been raised about the accuracy of the produced local additive explanations. We investigate this by studying whether some of the most popular explanation techniques can accurately explain the decisions of linear additive models. We show that even though the explanations generated by these techniques are linear additives, they can fail to provide accurate explanations when explaining linear additive models. In the experiments, we measure the accuracy of additive explanations, as produced by, e.g., LIME and SHAP, along with the non-additive explanations of Local Permutation Importance (LPI) when explaining Linear and Logistic Regression and Gaussian naive Bayes models over 40 tabular datasets. We also investigate the degree to which different factors, such as the number of numerical or categorical or correlated features, the predictive performance of the black-box model, explanation sample size, similarity metric, and the pre-processing technique used on the dataset can directly affect the accuracy of local explanations.

📄 PDF Abstract BibTeX

Code (1)

amir-rahnama/can_local_explanations_explain_lam 공식 구현

Tasks

Additive modelsExplanation Fidelity EvaluationFeature Importance

Methods 이 논문이 사용한 방법론

fail 설명 없음
SHAP 설명 없음
Logistic Regression Logistic Regression, despite its name, is a linear model for classification rather than regression. Logistic regression is also known in the literature as logit regression,…
LIME LIME, or Local Interpretable Model-Agnostic Explanations, is an algorithm that can explain the predictions of any classifier or regressor in a faithful way, by…

Similar Papers 제목 키워드 기반

Evaluating Local Explanations using White-box Models

2021-06-04 · Amir Hossein Akhavan Rahnama, Judith Butepage, Pierre Geurts, Henrik Bostrom

Evaluating explanation techniques using human subjects is costly, time-consuming and can lead to subjectivity in the assessments. To evaluate the accuracy of local explanations, we require access to the true feature impo…

Feature Importance

Considerations When Learning Additive Explanations for Black-Box Models

2018-01-26 · ICLR 2019 5 · Sarah Tan, Giles Hooker, Paul Koch, Albert Gordo 외

Many methods to explain black-box models, whether local or global, are additive. In this paper, we study global additive explanations for non-additive models, focusing on four explanation methods: partial dependence, Sha…

Additive models

SurvNAM: The machine learning survival model explanation

2021-04-18 · Lev V. Utkin, Egor D. Satyukov, Andrei V. Konstantinov

A new modification of the Neural Additive Model (NAM) called SurvNAM and its modifications are proposed to explain predictions of the black-box machine learning survival model. The method is based on applying the origina…

BIG-bench Machine LearningmodelSurvival Analysis

Instance-based Explanations for Gradient Boosting Machine Predictions with AXIL Weights

2023-01-05 · Paul Geertsema, Helen Lu

We show that regression predictions from linear and tree-based models can be represented as linear combinations of target instances in the training data. This also holds for models constructed as ensembles of trees, incl…

Feature Importanceregression

Evaluating Local Explainability Metrics for Machine Learning Models on Tabular Data

2026-05-26 · Tomás Pereira, João Vitorino, Eva Maia, Isabel Praça arxiv

Despite the wide use of explainability techniques to attempt to understand the behavior of Artificial Intelligence (AI), the generated explanations may not always be reliable. An explanation can appear plausible to human…