Conceptual Edits as Counterfactual Explanations
We propose a framework for generating counterfactual explanations of black-box classifiers, which answer the question “What has to change for this to be classified as X instead of Y?” in terms of given domain knowledge. Specifically, we identify minimal and meaningful “concept edits” which, when applied, change the prediction of a black-box classifier to a desired class. Furthermore, by accumulating multiple counterfactual explanations from interesting regions of a dataset, we propose a method to estimate a "global" counterfactual explanation for that region and a desired target class. We implement algorithms and show results from preliminary experiments employing CLEVR-Hans3 and COCO as datasets. The resulting explanations were useful, and even managed to unintendedly reveal a bias in the classifier’s training set, which was unknown to us.
Code (1)
Tasks
counterfactualCounterfactual ExplanationSimilar Papers 제목 키워드 기반
Graph Edits for Counterfactual Explanations: A comparative study
Counterfactuals have been established as a popular explainability technique which leverages a set of minimal edits to alter the prediction of a classifier. When considering conceptual counterfactuals on images, the edits…
counterfactualGraph Neural NetworkKnowledge GraphsV-CECE: Visual Counterfactual Explanations via Conceptual Edits
Recent black-box counterfactual generation frameworks fail to take into account the semantic content of the proposed edits, while relying heavily on training to guide the generation process. We propose a novel, plug-and-…
Image EditingChoose your Data Wisely: A Framework for Semantic Counterfactuals
Counterfactual explanations have been argued to be one of the most intuitive forms of explanation. They are typically defined as a minimal set of edits on a given data sample that, when applied, changes the output of a m…
counterfactualCounterfactual ExplanationKnowledge GraphsWould this change your answer? Evaluating Explanations of LLM Behavior In The Wild with Counterfactual Experiments
Many areas of AI research, such as language model interpretability and chain of thought faithfulness, seek to explain model behaviors. But what constitutes a "good" explanation? In this work, we evaluate explanations thr…
Counterfactual Explanations for Misclassified Images: How Human and Machine Explanations Differ
Counterfactual explanations have emerged as a popular solution for the eXplainable AI (XAI) problem of elucidating the predictions of black-box deep-learning systems due to their psychological validity, flexibility acros…
counterfactualExplainable Artificial Intelligence (XAI)