Instance-based Explanations for Gradient Boosting Machine Predictions with AXIL Weights
We show that regression predictions from linear and tree-based models can be represented as linear combinations of target instances in the training data. This also holds for models constructed as ensembles of trees, including Random Forests and Gradient Boosting Machines. The weights used in these linear combinations are measures of instance importance, complementing existing measures of feature importance, such as SHAP and LIME. We refer to these measures as AXIL weights (Additive eXplanations with Instance Loadings). Since AXIL weights are additive across instances, they offer both local and global explanations. Our work contributes to the broader effort to make machine learning predictions more interpretable and explainable.
Code (1)
Tasks
Feature ImportanceregressionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Explaining Predictions from Tree-based Boosting Ensembles
Understanding how "black-box" models arrive at their predictions has sparked significant interest from both within and outside the AI community. Our work focuses on doing this by generating local explanations about indiv…
counterfactualCounterfactual ExplanationExplanations Based on Item Response Theory (eXirt): A Model-Specific Method to Explain Tree-Ensemble Model in Trust Perspective
In recent years, XAI researchers have been formalizing proposals and developing new methods to explain black box models, with no general consensus in the community on which method to use to explain these models, with thi…
Binary ClassificationExplainable artificial intelligenceExplainable Artificial Intelligence (XAI)modelTree-based local explanations of machine learning model predictions, AraucanaXAI
Increasingly complex learning methods such as boosting, bagging and deep learning have made ML models more accurate, but harder to understand and interpret. A tradeoff between performance and intelligibility is often to …
BIG-bench Machine LearningClassificationExplainable Artificial Intelligence (XAI)regressionA Model of Causal Explanation on Neural Networks for Tabular Data
The problem of explaining the results produced by machine learning methods continues to attract attention. Neural network (NN) models, along with gradient boosting machines, are expected to be utilized even in tabular da…
Light Gradient Boosting Machine as a Regression Method for Quantitative Structure-Activity Relationships
In the pharmaceutical industry, where it is common to generate many QSAR models with large numbers of molecules and descriptors, the best QSAR methods are those that can generate the most accurate predictions but that ar…
Prediction Intervalsregression