Towards explainable classifiers using the counterfactual approach -- global explanations for discovering bias in data
The paper proposes summarized attribution-based post-hoc explanations for the detection and identification of bias in data. A global explanation is proposed, and a step-by-step framework on how to detect and test bias is introduced. Since removing unwanted bias is often a complicated and tremendous task, it is automatically inserted, instead. Then, the bias is evaluated with the proposed counterfactual approach. The obtained results are validated on a sample skin lesion dataset. Using the proposed method, a number of possible bias causing artifacts are successfully identified and confirmed in dermoscopy images. In particular, it is confirmed that black frames have a strong influence on Convolutional Neural Network's prediction: 22% of them changed the prediction from benign to malignant.
Code (1)
Tasks
Bias DetectioncounterfactualSimilar Papers 제목 키워드 기반
Counterfactual Graphs for Explainable Classification of Brain Networks
Training graph classifiers able to distinguish between healthy brains and dysfunctional ones, can help identifying substructures associated to specific cognitive phenotypes. However, the mere predictive power of the grap…
ClassificationcounterfactualExplainable Counterfactual Reasoning in Depression Medication Selection at Multi-Levels (Personalized and Population)
Background: This study investigates how variations in Major Depressive Disorder (MDD) symptoms, quantified by the Hamilton Rating Scale for Depression (HAM-D), causally influence the prescription of SSRIs versus SNRIs. M…
Feature ImportanceDiffusion Models for Counterfactual Explanations
Counterfactual explanations have shown promising results as a post-hoc framework to make image classifiers more explainable. In this paper, we propose DiME, a method allowing the generation of counterfactual images using…
counterfactualExplaining Reject Options of Learning Vector Quantization Classifiers
While machine learning models are usually assumed to always output a prediction, there also exist extensions in the form of reject options which allow the model to reject inputs where only a prediction with an unacceptab…
counterfactualQuantizationExplaining Image Classifiers Using Contrastive Counterfactuals in Generative Latent Spaces
Despite their high accuracies, modern complex image classifiers cannot be trusted for sensitive tasks due to their unknown decision-making process and potential biases. Counterfactual explanations are very effective in p…
AttributecounterfactualDecision Making