Towards a Rigorous Evaluation of Explainability for Multivariate Time Series
Machine learning-based systems are rapidly gaining popularity and in-line with that there has been a huge research surge in the field of explainability to ensure that machine learning models are reliable, fair, and can be held liable for their decision-making process. Explainable Artificial Intelligence (XAI) methods are typically deployed to debug black-box machine learning models but in comparison to tabular, text, and image data, explainability in time series is still relatively unexplored. The aim of this study was to achieve and evaluate model agnostic explainability in a time series forecasting problem. This work focused on proving a solution for a digital consultancy company aiming to find a data-driven approach in order to understand the effect of their sales related activities on the sales deals closed. The solution involved framing the problem as a time series forecasting problem to predict the sales deals and the explainability was achieved using two novel model agnostic explainability techniques, Local explainable model-agnostic explanations (LIME) and Shapley additive explanations (SHAP) which were evaluated using human evaluation of explainability. The results clearly indicate that the explanations produced by LIME and SHAP greatly helped lay humans in understanding the predictions made by the machine learning model. The presented work can easily be extended to any time
Code (0)
등록된 구현이 없습니다.
Tasks
BIG-bench Machine LearningDecision MakingExplainable artificial intelligenceExplainable Artificial Intelligence (XAI)Time SeriesTime Series AnalysisTime Series ForecastingMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
A Performance-Explainability Framework to Benchmark Machine Learning Methods: Application to Multivariate Time Series Classifiers
Our research aims to propose a new performance-explainability analytical framework to assess and benchmark machine learning methods. The framework details a set of characteristics that systematize the performance-explain…
BIG-bench Machine LearningTime SeriesTime Series AnalysisCounterfactual Explanations for Machine Learning on Multivariate Time Series Data
Applying machine learning (ML) on multivariate time series data has growing popularity in many application domains, including in computer system management. For example, recent high performance computing (HPC) research p…
BIG-bench Machine LearningcounterfactualManagementScheduling+2XEM: An Explainable-by-Design Ensemble Method for Multivariate Time Series Classification
We present XEM, an eXplainable-by-design Ensemble method for Multivariate time series classification. XEM relies on a new hybrid ensemble method that combines an explicit boosting-bagging approach to handle the bias-vari…
BIG-bench Machine LearningGeneral ClassificationTime SeriesTime Series Analysis+1DLFormer: Enhancing Explainability in Multivariate Time Series Forecasting using Distributed Lag Embedding
. Most real-world variables are multivariate time series influenced by past values and explanatory factors. Consequently, predicting these time series data using artificial intelligence is ongoing. In particular, in fiel…
Multivariate Time Series ForecastingTime SeriesTime Series ForecastingTime Series PredictionAnoViz: A Visual Inspection Tool of Anomalies in Multivariate Time Series
This paper presents AnoViz, a novel visualization tool of anomalies in multivariate time series, to support domain experts and data scientists in understanding anomalous instances in their systems. AnoViz provides an ove…
Time Series