Linear TreeShap

2022-09-16 · Peng Yu, Chao Xu, Albert Bifet, Jesse Read

Decision trees are well-known due to their ease of interpretability. To improve accuracy, we need to grow deep trees or ensembles of trees. These are hard to interpret, offsetting their original benefits. Shapley values have recently become a popular way to explain the predictions of tree-based machine learning models. It provides a linear weighting to features independent of the tree structure. The rise in popularity is mainly due to TreeShap, which solves a general exponential complexity problem in polynomial time. Following extensive adoption in the industry, more efficient algorithms are required. This paper presents a more efficient and straightforward algorithm: Linear TreeShap. Like TreeShap, Linear TreeShap is exact and requires the same amount of memory.

📄 PDF Abstract BibTeX arXiv:2209.08192

Code (1)

yupbank/linear_tree_shap 공식 구현

Beyond TreeSHAP: Efficient Computation of Any-Order Shapley Interactions for Tree Ensembles

2024-01-22 · Maximilian Muschalik, Fabian Fumagalli, Barbara Hammer, Eyke Hüllermeier

While shallow decision trees may be interpretable, larger ensemble models like gradient-boosted trees, which often set the state of the art in machine learning problems involving tabular data, still remain black box mode…

Explainable artificial intelligence Explainable Artificial Intelligence (XAI)

Fast TreeSHAP: Accelerating SHAP Value Computation for Trees

2021-09-20 · Jilei Yang

SHAP (SHapley Additive exPlanation) values are one of the leading tools for interpreting machine learning models, with strong theoretical guarantees (consistency, local accuracy) and a wide availability of implementation…

BIG-bench Machine Learning Computational Efficiency

Quadrature-TreeSHAP: Depth-Independent TreeSHAP and Shapley Interactions

2026-05-06 · Ron Wettenstein, Rory Mitchell, Peng Yu arxiv

Shapley values are a standard tool for explaining predictions of tree ensembles, with Path-Dependent SHAP being the most widely used variant. Despite substantial progress, existing methods still exhibit trade-offs betwee…

Understanding Interventional TreeSHAP : How and Why it Works

2022-09-29 · Gabriel Laberge, Yann Pequignot

Shapley values are ubiquitous in interpretable Machine Learning due to their strong theoretical background and efficient implementation in the SHAP library. Computing these values previously induced an exponential cost w…

Interpretable Machine Learning

GPUTreeShap: Massively Parallel Exact Calculation of SHAP Scores for Tree Ensembles

2020-10-27 · Rory Mitchell, Eibe Frank, Geoffrey Holmes

SHAP (SHapley Additive exPlanation) values provide a game theoretic interpretation of the predictions of machine learning models based on Shapley values. While exact calculation of SHAP values is computationally intracta…

BIG-bench Machine Learning CPU GPU