Robustness of Explainable Artificial Intelligence in Industrial Process Modelling
eXplainable Artificial Intelligence (XAI) aims at providing understandable explanations of black box models. In this paper, we evaluate current XAI methods by scoring them based on ground truth simulations and sensitivity analysis. To this end, we used an Electric Arc Furnace (EAF) model to better understand the limits and robustness characteristics of XAI methods such as SHapley Additive exPlanations (SHAP), Local Interpretable Model-agnostic Explanations (LIME), as well as Averaged Local Effects (ALE) or Smooth Gradients (SG) in a highly topical setting. These XAI methods were applied to various types of black-box models and then scored based on their correctness compared to the ground-truth sensitivity of the data-generating processes using a novel scoring evaluation methodology over a range of simulated additive noise. The resulting evaluation shows that the capability of the Machine Learning (ML) models to capture the process accurately is, indeed, coupled with the correctness of the explainability of the underlying data-generating process. We furthermore show the differences between XAI methods in their ability to correctly predict the true sensitivity of the modeled industrial process.
Code (0)
등록된 구현이 없습니다.
Tasks
ARCExplainable artificial intelligenceExplainable Artificial Intelligence (XAI)SensitivityMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Enhancing Feature Selection and Interpretability in AI Regression Tasks Through Feature Attribution
Research in Explainable Artificial Intelligence (XAI) is increasing, aiming to make deep learning models more transparent. Most XAI methods focus on justifying the decisions made by Artificial Intelligence (AI) systems i…
Deep LearningExplainable artificial intelligenceExplainable Artificial Intelligence (XAI)feature selection+1Human in the AI loop via xAI and Active Learning for Visual Inspection
Industrial revolutions have historically disrupted manufacturing by introducing automation into production. Increasing automation reshapes the role of the human worker. Advances in robotics and artificial intelligence op…
Active LearningExplainable artificial intelligenceExplainable Artificial Intelligence (XAI)Explainable Artificial Intelligence: Precepts, Methods, and Opportunities for Research in Construction
Explainable artificial intelligence has received limited attention in construction despite its growing importance in various other industrial sectors. In this paper, we provide a narrative review of XAI to raise awarenes…
Explainable artificial intelligenceExplainable Artificial Intelligence (XAI)Explainable Artificial Intelligence Techniques for Accurate Fault Detection and Diagnosis: A Review
As the manufacturing industry advances with sensor integration and automation, the opaque nature of deep learning models in machine learning poses a significant challenge for fault detection and diagnosis. And despite th…
Decision MakingExplainable artificial intelligenceFault DetectionDeep Learning, Natural Language Processing, and Explainable Artificial Intelligence in the Biomedical Domain
In this article, we first give an introduction to artificial intelligence and its applications in biology and medicine in Section 1. Deep learning methods are then described in Section 2. We narrow down the focus of the …
Explainable artificial intelligence