Explaining and visualizing black-box models through counterfactual paths
Explainable AI (XAI) is an increasingly important area of machine learning research, which aims to make black-box models transparent and interpretable. In this paper, we propose a novel approach to XAI that uses the so-called counterfactual paths generated by conditional permutations of features. The algorithm measures feature importance by identifying sequential permutations of features that most influence changes in model predictions. It is particularly suitable for generating explanations based on counterfactual paths in knowledge graphs incorporating domain knowledge. Counterfactual paths introduce an additional graph dimension to current XAI methods in both explaining and visualizing black-box models. Experiments with synthetic and medical data demonstrate the practical applicability of our approach.
Code (1)
Tasks
counterfactualExplainable Artificial Intelligence (XAI)Feature ImportanceKnowledge GraphsSimilar Papers 제목 키워드 기반
Explaining Black-Box Models through Counterfactuals
We present CounterfactualExplanations.jl: a package for generating Counterfactual Explanations (CE) and Algorithmic Recourse (AR) for black-box models in Julia. CE explain how inputs into a model need to change to yield …
counterfactualExplainable artificial intelligenceVisualizing Convolutional Neural Networks to Improve Decision Support for Skin Lesion Classification
Because of their state-of-the-art performance in computer vision, CNNs are becoming increasingly popular in a variety of fields, including medicine. However, as neural networks are black box function approximators, it is…
General ClassificationLesion ClassificationSkin Lesion ClassificationInstance-based Counterfactual Explanations for Time Series Classification
In recent years, there has been a rapidly expanding focus on explaining the predictions made by black-box AI systems that handle image and tabular data. However, considerably less attention has been paid to explaining th…
ClassificationcounterfactualCounterfactual ExplanationDynamic Time Warping+4Zero-shot LLM-guided Counterfactual Generation: A Case Study on NLP Model Evaluation
With the development and proliferation of large, complex, black-box models for solving many natural language processing (NLP) tasks, there is also an increasing necessity of methods to stress-test these models and provid…
counterfactualInstruction FollowingCheXplaining in Style: Counterfactual Explanations for Chest X-rays using StyleGAN
Deep learning models used in medical image analysis are prone to raising reliability concerns due to their black-box nature. To shed light on these black-box models, previous works predominantly focus on identifying the …
counterfactualMedical Image Analysis