Explaining Classifications to Non Experts: An XAI User Study of Post Hoc Explanations for a Classifier When People Lack Expertise
Very few eXplainable AI (XAI) studies consider how users understanding of explanations might change depending on whether they know more or less about the to be explained domain (i.e., whether they differ in their expertise). Yet, expertise is a critical facet of most high stakes, human decision making (e.g., understanding how a trainee doctor differs from an experienced consultant). Accordingly, this paper reports a novel, user study (N=96) on how peoples expertise in a domain affects their understanding of post-hoc explanations by example for a deep-learning, black box classifier. The results show that peoples understanding of explanations for correct and incorrect classifications changes dramatically, on several dimensions (e.g., response times, perceptions of correctness and helpfulness), when the image-based domain considered is familiar (i.e., MNIST) as opposed to unfamiliar (i.e., Kannada MNIST). The wider implications of these new findings for XAI strategies are discussed.
Code (0)
등록된 구현이 없습니다.
Tasks
Decision MakingExplainable Artificial Intelligence (XAI)Similar Papers 제목 키워드 기반
Investigating ADR mechanisms with knowledge graph mining and explainable AI
Adverse Drug Reactions (ADRs) are characterized within randomized clinical trials and postmarketing pharmacovigilance, but their molecular mechanism remains unknown in most cases. Aside from clinical trials, many element…
Explainable ModelsGraph MiningKnowledge GraphsPharmacovigilancePredictability and Comprehensibility in Post-Hoc XAI Methods: A User-Centered Analysis
Post-hoc explainability methods aim to clarify predictions of black-box machine learning models. However, it is still largely unclear how well users comprehend the provided explanations and whether these increase the use…
counterfactualFeature-Guided Neighbor Selection for Non-Expert Evaluation of Model Predictions
Explainable AI (XAI) methods often struggle to generate clear, interpretable outputs for users without domain expertise. We introduce Feature-Guided Neighbor Selection (FGNS), a post hoc method that enhances interpretabi…
Feature ImportanceExplainable Deep Image Classifiers for Skin Lesion Diagnosis
A key issue in critical contexts such as medical diagnosis is the interpretability of the deep learning models adopted in decision-making systems. Research in eXplainable Artificial Intelligence (XAI) is trying to solve …
Decision MakingExplainable artificial intelligenceExplainable Artificial Intelligence (XAI)Medical DiagnosisInteractive Naming for Explaining Deep Neural Networks: A Formative Study
We consider the problem of explaining the decisions of deep neural networks for image recognition in terms of human-recognizable visual concepts. In particular, given a test set of images, we aim to explain each classifi…
General Classification