Towards Human Cognition Level-based Experiment Design for Counterfactual Explanations (XAI)
Explainable Artificial Intelligence (XAI) has recently gained a swell of interest, as many Artificial Intelligence (AI) practitioners and developers are compelled to rationalize how such AI-based systems work. Decades back, most XAI systems were developed as knowledge-based or expert systems. These systems assumed reasoning for the technical description of an explanation, with little regard for the user's cognitive capabilities. The emphasis of XAI research appears to have turned to a more pragmatic explanation approach for better understanding. An extensive area where cognitive science research may substantially influence XAI advancements is evaluating user knowledge and feedback, which are essential for XAI system evaluation. To this end, we propose a framework to experiment with generating and evaluating the explanations on the grounds of different cognitive levels of understanding. In this regard, we adopt Bloom's taxonomy, a widely accepted model for assessing the user's cognitive capability. We utilize the counterfactual explanations as an explanation-providing medium encompassed with user feedback to validate the levels of understanding about the explanation at each cognitive level and improvise the explanation generation methods accordingly.
Code (0)
등록된 구현이 없습니다.
Tasks
counterfactualExplainable artificial intelligenceExplainable Artificial Intelligence (XAI)Explanation GenerationSimilar Papers 제목 키워드 기반
What If the TV Was Off? Examining Counterfactual Reasoning Abilities of Multi-modal Language Models
Counterfactual reasoning, a fundamental aspect of human cognition, involves contemplating alternatives to established facts or past events, significantly enhancing our abilities in planning and decision-making. In light …
BenchmarkingCode GenerationcounterfactualCounterfactual Reasoning+2Hierarchical and Multimodal Data for Daily Activity Understanding
Daily Activity Recordings for Artificial Intelligence (DARai, pronounced "Dahr-ree") is a multimodal, hierarchically annotated dataset constructed to understand human activities in real-world settings. DARai consists of …
Action AnticipationcounterfactualElectromyography (EMG)Sensor Fusion+1SemEval-2020 Task 5: Counterfactual Recognition
We present a counterfactual recognition (CR) task, the shared Task 5 of SemEval-2020. Counterfactuals describe potential outcomes (consequents) produced by actions or circumstances that did not happen or cannot happen an…
counterfactualCounterfactual DetectionCounterfactual InferenceSentenceRecursive Counterfactual Deconfounding for Object Recognition
Image recognition is a classic and common task in the computer vision field, which has been widely applied in the past decade. Most existing methods in literature aim to learn discriminative features from labeled images …
counterfactualObjectObject RecognitionOpen Set LearningCX-ToM: Counterfactual Explanations with Theory-of-Mind for Enhancing Human Trust in Image Recognition Models
We propose CX-ToM, short for counterfactual explanations with theory-of mind, a new explainable AI (XAI) framework for explaining decisions made by a deep convolutional neural network (CNN). In contrast to the current me…
counterfactualExplainable Artificial Intelligence (XAI)