Towards Fine-Grained Interpretability: Counterfactual Explanations for Misclassification with Saliency Partition
Attribution-based explanation techniques capture key patterns to enhance visual interpretability. However, these patterns often lack the granularity needed for insight in fine-grained tasks, particularly in cases of model misclassification, where explanations may be insufficiently detailed. To address this limitation, we propose a fine-grained counterfactual explanation framework that generates both object-level and part-level interpretability, addressing two fundamental questions: (1) which fine-grained features contribute to model misclassification, and (2) where dominant local features influence counterfactual adjustments. Our approach yields explainable counterfactuals in a non-generative manner by quantifying similarity and weighting component contributions within regions of interest between correctly classified and misclassified samples. Furthermore, we introduce an importance-isolation module grounded in Shapley value contributions, isolating features with region-specific relevance. Extensive experiments demonstrate the superiority of our approach in capturing more granular, intuitively meaningful regions, surpassing fine-grained methods.
Code (0)
등록된 구현이 없습니다.
Tasks
counterfactualCounterfactual ExplanationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Towards Fine-Grained Interpretability: Counterfactual Explanations for Misclassification with Saliency Partition
Attribution-based explanation techniques capture key patterns to enhance visual interpretability; however, these patterns often lack the granularity needed for insight in fine-grained tasks, particularly in cases of mode…
Counterfactual Visual Explanations
In this work, we develop a technique to produce counterfactual visual explanations. Given a 'query' image $I$ for which a vision system predicts class $c$, a counterfactual visual explanation identifies how $I$ could cha…
counterfactualGeneral Classificationimage-classificationImage ClassificationCounterfactual Explanations for Misclassified Images: How Human and Machine Explanations Differ
Counterfactual explanations have emerged as a popular solution for the eXplainable AI (XAI) problem of elucidating the predictions of black-box deep-learning systems due to their psychological validity, flexibility acros…
counterfactualExplainable Artificial Intelligence (XAI)Explainable Image Classification with Evidence Counterfactual
The complexity of state-of-the-art modeling techniques for image classification impedes the ability to explain model predictions in an interpretable way. Existing explanation methods generally create importance rankings …
ClassificationcounterfactualCounterfactual ExplanationFeature Importance+3Integrating Prior Knowledge in Post-hoc Explanations
In the field of eXplainable Artificial Intelligence (XAI), post-hoc interpretability methods aim at explaining to a user the predictions of a trained decision model. Integrating prior knowledge into such interpretability…
counterfactualCounterfactual ExplanationExplainable artificial intelligenceExplainable Artificial Intelligence (XAI)