Generating Explainable Rule Sets from Tree-Ensemble Learning Methods by Answer Set Programming
We propose a method for generating explainable rule sets from tree-ensemble learners using Answer Set Programming (ASP). To this end, we adopt a decompositional approach where the split structures of the base decision trees are exploited in the construction of rules, which in turn are assessed using pattern mining methods encoded in ASP to extract interesting rules. We show how user-defined constraints and preferences can be represented declaratively in ASP to allow for transparent and flexible rule set generation, and how rules can be used as explanations to help the user better understand the models. Experimental evaluation with real-world datasets and popular tree-ensemble algorithms demonstrates that our approach is applicable to a wide range of classification tasks.
Code (1)
Tasks
Ensemble LearningSimilar Papers 제목 키워드 기반
RCProb: Probabilistic Rule Extraction for Efficient Simplification of Tree Ensembles
Tree ensembles are widely used in industrial machine learning due to their strong predictive performance and efficient training procedures. However, as the number of trees in an ensemble grows, the resulting models becom…
Generating Global and Local Explanations for Tree-Ensemble Learning Methods by Answer Set Programming
We propose a method for generating rule sets as global and local explanations for tree-ensemble learning methods using Answer Set Programming (ASP). To this end, we adopt a decompositional approach where the split struct…
Ensemble LearningUtilising Explainable Techniques for Quality Prediction in a Complex Textiles Manufacturing Use Case
This paper develops an approach to classify instances of product failure in a complex textiles manufacturing dataset using explainable techniques. The dataset used in this study was obtained from a New Zealand manufactur…
feature selectionBELLATREX: Building Explanations through a LocaLly AccuraTe Rule EXtractor
Tree-ensemble algorithms, such as random forest, are effective machine learning methods popular for their flexibility, high performance, and robustness to overfitting. However, since multiple learners are combined, they …
Binary ClassificationMulti-Label ClassificationMUlTI-LABEL-ClASSIFICATIONTE2Rules: Explaining Tree Ensembles using Rules
Tree Ensemble (TE) models, such as Gradient Boosted Trees, often achieve optimal performance on tabular datasets, yet their lack of transparency poses challenges for comprehending their decision logic. This paper introdu…
Binary ClassificationDecision MakingExplainable artificial intelligenceExplanation Generation