Feature Necessity & Relevancy in ML Classifier Explanations
Given a machine learning (ML) model and a prediction, explanations can be defined as sets of features which are sufficient for the prediction. In some applications, and besides asking for an explanation, it is also critical to understand whether sensitive features can occur in some explanation, or whether a non-interesting feature must occur in all explanations. This paper starts by relating such queries respectively with the problems of relevancy and necessity in logic-based abduction. The paper then proves membership and hardness results for several families of ML classifiers. Afterwards the paper proposes concrete algorithms for two classes of classifiers. The experimental results confirm the scalability of the proposed algorithms.
Code (1)
Tasks
PredictionSimilar Papers 제목 키워드 기반
Feature Relevancy, Necessity and Usefulness: Complexity and Algorithms
Given a classification model and a prediction for some input, there are heuristic strategies for ranking features according to their importance in regard to the prediction. One common approach to this task is rooted in p…
CheXplaining in Style: Counterfactual Explanations for Chest X-rays using StyleGAN
Deep learning models used in medical image analysis are prone to raising reliability concerns due to their black-box nature. To shed light on these black-box models, previous works predominantly focus on identifying the …
counterfactualMedical Image AnalysisNecessity and Sufficiency for Explaining Text Classifiers: A Case Study in Hate Speech Detection
We present a novel feature attribution method for explaining text classifiers, and analyze it in the context of hate speech detection. Although feature attribution models usually provide a single importance score for eac…
Hate Speech DetectionExplaining Image Classifiers
We focus on explaining image classifiers, taking the work of Mothilal et al. [2021] (MMTS) as our point of departure. We observe that, although MMTS claim to be using the definition of explanation proposed by Halpern [20…
Explaining Image Classifiers Using Contrastive Counterfactuals in Generative Latent Spaces
Despite their high accuracies, modern complex image classifiers cannot be trusted for sensitive tasks due to their unknown decision-making process and potential biases. Counterfactual explanations are very effective in p…
AttributecounterfactualDecision Making