What Does Explainable AI Really Mean? A New Conceptualization of Perspectives
We characterize three notions of explainable AI that cut across research fields: opaque systems that offer no insight into its algo- rithmic mechanisms; interpretable systems where users can mathemat- ically analyze its algorithmic mechanisms; and comprehensible systems that emit symbols enabling user-driven explanations of how a conclusion is reached. The paper is motivated by a corpus analysis of NIPS, ACL, COGSCI, and ICCV/ECCV paper titles showing differences in how work on explainable AI is positioned in various fields. We close by introducing a fourth notion: truly explainable systems, where automated reasoning is central to output crafted explanations without requiring human post processing as final step of the generative process.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Teaching and Critiquing Conceptualization and Operationalization in NLP
NLP researchers regularly invoke abstract concepts like "interpretability," "bias," "reasoning," and "stereotypes," without defining them. Each subfield has a shared understanding or conceptualization of what these terms…
Diversity of What? On the Different Conceptualizations of Diversity in Recommender Systems
Diversity is a commonly known principle in the design of recommender systems, but also ambiguous in its conceptualization. Through semi-structured interviews we explore how practitioners at three different public service…
DiversityRecommendation SystemsXplaiNLI: Explainable Natural Language Inference through Visual Analytics
Advances in Natural Language Inference (NLI) have helped us understand what state-of-the-art models really learn and what their generalization power is. Recent research has revealed some heuristics and biases of these mo…
Natural Language InferenceA Survey of Explainable AI and Proposal for a Discipline of Explanation Engineering
In this survey paper, we deep dive into the field of Explainable Artificial Intelligence (XAI). After introducing the scope of this paper, we start by discussing what an "explanation" really is. We then move on to discus…
Autonomous DrivingExplainable artificial intelligenceExplainable Artificial Intelligence (XAI)ExplainaBoard: An Explainable Leaderboard for NLP
With the rapid development of NLP research, leaderboards have emerged as one tool to track the performance of various systems on various NLP tasks. They are effective in this goal to some extent, but generally present a …
Machine Translation