GANterfactual - Counterfactual Explanations for Medical Non-Experts using Generative Adversarial Learning
With the ongoing rise of machine learning, the need for methods for explaining decisions made by artificial intelligence systems is becoming a more and more important topic. Especially for image classification tasks, many state-of-the-art tools to explain such classifiers rely on visual highlighting of important areas of the input data. Contrary, counterfactual explanation systems try to enable a counterfactual reasoning by modifying the input image in a way such that the classifier would have made a different prediction. By doing so, the users of counterfactual explanation systems are equipped with a completely different kind of explanatory information. However, methods for generating realistic counterfactual explanations for image classifiers are still rare. Especially in medical contexts, where relevant information often consists of textural and structural information, high-quality counterfactual images have the potential to give meaningful insights into decision processes. In this work, we present GANterfactual, an approach to generate such counterfactual image explanations based on adversarial image-to-image translation techniques. Additionally, we conduct a user study to evaluate our approach in an exemplary medical use case. Our results show that, in the chosen medical use-case, counterfactual explanations lead to significantly better results regarding mental models, explanation satisfaction, trust, emotions, and self-efficacy than two state-of-the-art systems that work with saliency maps, namely LIME and LRP.
Code (1)
Tasks
counterfactualCounterfactual ExplanationCounterfactual ReasoningFeature Importanceimage-classificationImage ClassificationImage-to-Image TranslationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
GANterfactual-RL: Understanding Reinforcement Learning Agents' Strategies through Visual Counterfactual Explanations
Counterfactual explanations are a common tool to explain artificial intelligence models. For Reinforcement Learning (RL) agents, they answer "Why not?" or "What if?" questions by illustrating what minimal change to a sta…
counterfactualDecision Makingreinforcement-learningReinforcement Learning (RL)Counterfactual State Explanations for Reinforcement Learning Agents via Generative Deep Learning
Counterfactual explanations, which deal with "why not?" scenarios, can provide insightful explanations to an AI agent's behavior. In this work, we focus on generating counterfactual explanations for deep reinforcement le…
counterfactualDeep Reinforcement Learningreinforcement-learningReinforcement Learning (RL)MiMICRI: Towards Domain-centered Counterfactual Explanations of Cardiovascular Image Classification Models
The recent prevalence of publicly accessible, large medical imaging datasets has led to a proliferation of artificial intelligence (AI) models for cardiovascular image classification and analysis. At the same time, the p…
counterfactualimage-classificationImage ClassificationStyle-transfer counterfactual explanations: An application to mortality prevention of ICU patients
In recent years, machine learning methods have been rapidly adopted in the medical domain. However, current state-of-the-art medical mining methods usually produce opaque, black-box models. To address the lack of model t…
counterfactualCounterfactual ExplanationInterpretable Machine LearningStyle Transfer+1SCE-LITE-HQ: Smooth visual counterfactual explanations with generative foundation models
Modern neural networks achieve strong performance but remain difficult to interpret in high-dimensional visual domains. Counterfactual explanations (CFEs) provide a principled approach to interpreting black-box predictio…