Towards Benchmarking Explainable Artificial Intelligence Methods
The currently dominating artificial intelligence and machine learning technology, neural networks, builds on inductive statistical learning. Neural networks of today are information processing systems void of understanding and reasoning capabilities, consequently, they cannot explain promoted decisions in a humanly valid form. In this work, we revisit and use fundamental philosophy of science theories as an analytical lens with the goal of revealing, what can be expected, and more importantly, not expected, from methods that aim to explain decisions promoted by a neural network. By conducting a case study we investigate a selection of explainability method's performance over two mundane domains, animals and headgear. Through our study, we lay bare that the usefulness of these methods relies on human domain knowledge and our ability to understand, generalise and reason. The explainability methods can be useful when the goal is to gain further insights into a trained neural network's strengths and weaknesses. If our aim instead is to use these explainability methods to promote actionable decisions or build trust in ML-models they need to be less ambiguous than they are today. In this work, we conclude from our study, that benchmarking explainability methods, is a central quest towards trustworthy artificial intelligence and machine learning.
Code (0)
등록된 구현이 없습니다.
Tasks
BenchmarkingExplainable artificial intelligencePhilosophyvalidSimilar Papers 제목 키워드 기반
EXACT: Towards a platform for empirically benchmarking Machine Learning model explanation methods
The evolving landscape of explainable artificial intelligence (XAI) aims to improve the interpretability of intricate machine learning (ML) models, yet faces challenges in formalisation and empirical validation, being an…
BenchmarkingExplainable artificial intelligenceExplainable Artificial Intelligence (XAI)Deep Learning, Natural Language Processing, and Explainable Artificial Intelligence in the Biomedical Domain
In this article, we first give an introduction to artificial intelligence and its applications in biology and medicine in Section 1. Deep learning methods are then described in Section 2. We narrow down the focus of the …
Explainable artificial intelligenceAnalysis of Explainable Artificial Intelligence Methods on Medical Image Classification
The use of deep learning in computer vision tasks such as image classification has led to a rapid increase in the performance of such systems. Due to this substantial increment in the utility of these systems, the use of…
Decision MakingExplainable artificial intelligenceExplainable Artificial Intelligence (XAI)image-classification+2Explanation in Artificial Intelligence: Insights from the Social Sciences
There has been a recent resurgence in the area of explainable artificial intelligence as researchers and practitioners seek to make their algorithms more understandable. Much of this research is focused on explicitly exp…
Explainable artificial intelligencePhilosophyComprehensible Artificial Intelligence on Knowledge Graphs: A survey
Artificial Intelligence applications gradually move outside the safe walls of research labs and invade our daily lives. This is also true for Machine Learning methods on Knowledge Graphs, which has led to a steady increa…
Explainable artificial intelligenceInterpretable Machine LearningKnowledge GraphsSurvey