Leveraging Model-based Trees as Interpretable Surrogate Models for Model Distillation
Surrogate models play a crucial role in retrospectively interpreting complex and powerful black box machine learning models via model distillation. This paper focuses on using model-based trees as surrogate models which partition the feature space into interpretable regions via decision rules. Within each region, interpretable models based on additive main effects are used to approximate the behavior of the black box model, striking for an optimal balance between interpretability and performance. Four model-based tree algorithms, namely SLIM, GUIDE, MOB, and CTree, are compared regarding their ability to generate such surrogate models. We investigate fidelity, interpretability, stability, and the algorithms' capability to capture interaction effects through appropriate splits. Based on our comprehensive analyses, we finally provide an overview of user-specific recommendations.
Code (1)
Tasks
modelSimilar Papers 제목 키워드 기반
Enhancing LIME using Neural Decision Trees
Interpreting complex machine learning models is a critical challenge, especially for tabular data where model transparency is paramount. Local Interpretable Model-Agnostic Explanations (LIME) has been a very popular fram…
Interpretable Machine LearningFair Feature Importance Scores for Interpreting Tree-Based Methods and Surrogates
Across various sectors such as healthcare, criminal justice, national security, finance, and technology, large-scale machine learning (ML) and artificial intelligence (AI) systems are being deployed to make critical data…
FairnessFeature ImportanceKnowledge DistillationInterpretable Local Tree Surrogate Policies
High-dimensional policies, such as those represented by neural networks, cannot be reasonably interpreted by humans. This lack of interpretability reduces the trust users have in policy behavior, limiting their use to lo…
An Interpretable Rule Creation Method for Black-Box Models based on Surrogate Trees -- SRules
As artificial intelligence (AI) systems become increasingly integrated into critical decision-making processes, the need for transparent and interpretable models has become paramount. In this article we present a new rul…
Decision MakingConcept Tree: High-Level Representation of Variables for More Interpretable Surrogate Decision Trees
Interpretable surrogates of black-box predictors trained on high-dimensional tabular datasets can struggle to generate comprehensible explanations in the presence of correlated variables. We propose a model-agnostic inte…