Comparing Feature Importance and Rule Extraction for Interpretability on Text Data
Complex machine learning algorithms are used more and more often in critical tasks involving text data, leading to the development of interpretability methods. Among local methods, two families have emerged: those computing importance scores for each feature and those extracting simple logical rules. In this paper we show that using different methods can lead to unexpectedly different explanations, even when applied to simple models for which we would expect qualitative coincidence. To quantify this effect, we propose a new approach to compare explanations produced by different methods.
Code (1)
Tasks
Feature ImportanceSimilar Papers 제목 키워드 기반
Enhancing interpretability of rule-based classifiers through feature graphs
In domains where transparency and trustworthiness are crucial, such as healthcare, rule-based systems are widely used and often preferred over black-box models for decision support systems due to their inherent interpret…
DiagnosticFeature ImportanceSnapToGrid: From Statistical to Interpretable Models for Biomedical Information Extraction
We propose an approach for biomedical information extraction that marries the advantages of machine learning models, e.g., learning directly from data, with the benefits of rule-based approaches, e.g., interpretability. …
BIG-bench Machine LearningEvent ExtractionThe Yield Curve as a Recession Leading Indicator. An Application for Gradient Boosting and Random Forest
Most representative decision tree ensemble methods have been used to examine the variable importance of Treasury term spreads to predict US economic recessions with a balance of generating rules for US economic recession…
Feature ImportanceEvolutionary Rule Extraction from Corporate Default Prediction Models
Small and medium-sized enterprises (SMEs) represent the majority of firms in most economies and often face financial constraints and higher vulnerability to financial distress. Predicting SME default is therefore crucial…
Deep Image Feature Learning With Fuzzy Rules
Feature extraction methods are key to many image processing tasks. At present, the most popular method is to use a deep neural network to automatically extract features through end-to-end training instead of the traditio…