paper-with-me

홈 › Papers

Learning Locally Interpretable Rule Ensemble

2023-06-20 · Kentaro Kanamori

This paper proposes a new framework for learning a rule ensemble model that is both accurate and interpretable. A rule ensemble is an interpretable model based on the linear combination of weighted rules. In practice, we often face the trade-off between the accuracy and interpretability of rule ensembles. That is, a rule ensemble needs to include a sufficiently large number of weighted rules to maintain its accuracy, which harms its interpretability for human users. To avoid this trade-off and learn an interpretable rule ensemble without degrading accuracy, we introduce a new concept of interpretability, named local interpretability, which is evaluated by the total number of rules necessary to express individual predictions made by the model, rather than to express the model itself. Then, we propose a regularizer that promotes local interpretability and develop an efficient algorithm for learning a rule ensemble with the proposed regularizer by coordinate descent with local search. Experimental results demonstrated that our method learns rule ensembles that can explain individual predictions with fewer rules than the existing methods, including RuleFit, while maintaining comparable accuracy.

📄 PDF Abstract BibTeX arXiv:2306.11481

Code (1)

kelicht/lire 공식 구현

Similar Papers 제목 키워드 기반

BELLATREX: Building Explanations through a LocaLly AccuraTe Rule EXtractor

2022-03-29 · Klest Dedja, Felipe Kenji Nakano, Konstantinos Pliakos, Celine Vens

Tree-ensemble algorithms, such as random forest, are effective machine learning methods popular for their flexibility, high performance, and robustness to overfitting. However, since multiple learners are combined, they …

Binary ClassificationMulti-Label ClassificationMUlTI-LABEL-ClASSIFICATION

Locally Interpretable Individualized Treatment Rules for Black-Box Decision Models

2026-02-12 · Yasin Khadem Charvadeh, Katherine S. Panageas, Yuan Chen arxiv

Individualized treatment rules (ITRs) aim to optimize healthcare by tailoring treatment decisions to patient-specific characteristics. Existing methods typically rely on either interpretable but inflexible models or high…

LIBRE: Learning Interpretable Boolean Rule Ensembles

2019-11-15 · Graziano Mita, Paolo Papotti, Maurizio Filippone, Pietro Michiardi

We present a novel method - LIBRE - to learn an interpretable classifier, which materializes as a set of Boolean rules. LIBRE uses an ensemble of bottom-up weak learners operating on a random subset of features, which al…

A Unified Approach to Extract Interpretable Rules from Tree Ensembles via Integer Programming

2024-06-30 · Lorenzo Bonasera, Emilio Carrizosa

Tree ensembles are very popular machine learning models, known for their effectiveness in supervised classification and regression tasks. Their performance derives from aggregating predictions of multiple decision trees,…

regressionTime Series

FIRE: An Optimization Approach for Fast Interpretable Rule Extraction

2023-06-12 · Brian Liu, Rahul Mazumder

We present FIRE, Fast Interpretable Rule Extraction, an optimization-based framework to extract a small but useful collection of decision rules from tree ensembles. FIRE selects sparse representative subsets of rules fro…