paper-with-me

홈 › Papers

What Makes a Good Explanation?: A Harmonized View of Properties of Explanations

2022-11-10 · Zixi Chen, Varshini Subhash, Marton Havasi, Weiwei Pan, Finale Doshi-Velez

Interpretability provides a means for humans to verify aspects of machine learning (ML) models and empower human+ML teaming in situations where the task cannot be fully automated. Different contexts require explanations with different properties. For example, the kind of explanation required to determine if an early cardiac arrest warning system is ready to be integrated into a care setting is very different from the type of explanation required for a loan applicant to help determine the actions they might need to take to make their application successful. Unfortunately, there is a lack of standardization when it comes to properties of explanations: different papers may use the same term to mean different quantities, and different terms to mean the same quantity. This lack of a standardized terminology and categorization of the properties of ML explanations prevents us from both rigorously comparing interpretable machine learning methods and identifying what properties are needed in what contexts. In this work, we survey properties defined in interpretable machine learning papers, synthesize them based on what they actually measure, and describe the trade-offs between different formulations of these properties. In doing so, we enable more informed selection of task-appropriate formulations of explanation properties as well as standardization for future work in interpretable machine learning.

📄 PDF Abstract BibTeX arXiv:2211.05667

Code (0)

등록된 구현이 없습니다.

Tasks

Interpretable Machine Learning

Similar Papers 제목 키워드 기반

Explainable AI: Definition and attributes of a good explanation for health AI

2024-09-09 · Evangelia Kyrimi, Scott McLachlan, Jared M Wohlgemut, Zane B Perkins 외

Proposals of artificial intelligence (AI) solutions based on increasingly complex and accurate predictive models are becoming ubiquitous across many disciplines. As the complexity of these models grows, transparency and …

Explanation in Human-AI Systems: A Literature Meta-Review, Synopsis of Key Ideas and Publications, and Bibliography for Explainable AI

2019-02-05 · Shane T. Mueller, Robert R. Hoffman, William Clancey, Abigail Emrey 외

This is an integrative review that address the question, "What makes for a good explanation?" with reference to AI systems. Pertinent literatures are vast. Thus, this review is necessarily selective. That said, most of t…

ArticlesExplainable Artificial Intelligence (XAI)

Explanations that reveal all through the definition of encoding

2024-11-04 · Aahlad Puli, Nhi Nguyen, Rajesh Ranganath

Feature attributions attempt to highlight what inputs drive predictive power. Good attributions or explanations are thus those that produce inputs that retain this predictive power; accordingly, evaluations of explanatio…

AllSentiment Analysis

Explaining Explanations in AI

2018-11-04 · Brent Mittelstadt, Chris Russell, Sandra Wachter

Recent work on interpretability in machine learning and AI has focused on the building of simplified models that approximate the true criteria used to make decisions. These models are a useful pedagogical device for teac…

BIG-bench Machine LearningPhilosophySociology

Evaluating Explanations: An Explanatory Virtues Framework for Mechanistic Interpretability -- The Strange Science Part I.ii

2025-05-02 · Kola Ayonrinde, Louis Jaburi

Mechanistic Interpretability (MI) aims to understand neural networks through causal explanations. Though MI has many explanation-generating methods, progress has been limited by the lack of a universal approach to evalua…

Philosophy