paper-with-me

홈 › Papers

Improving the Evaluation and Actionability of Explanation Methods for Multivariate Time Series Classification

2024-06-18 · Davide Italo Serramazza, Thach Le Nguyen, Georgiana Ifrim

Explanation for Multivariate Time Series Classification (MTSC) is an important topic that is under explored. There are very few quantitative evaluation methodologies and even fewer examples of actionable explanation, where the explanation methods are shown to objectively improve specific computational tasks on time series data. In this paper we focus on analyzing InterpretTime, a recent evaluation methodology for attribution methods applied to MTSC. We showcase some significant weaknesses of the original methodology and propose ideas to improve both its accuracy and efficiency. Unlike related work, we go beyond evaluation and also showcase the actionability of the produced explainer ranking, by using the best attribution methods for the task of channel selection in MTSC. We find that perturbation-based methods such as SHAP and Feature Ablation work well across a set of datasets, classifiers and tasks and outperform gradient-based methods. We apply the best ranked explainers to channel selection for MTSC and show significant data size reduction and improved classifier accuracy.

📄 PDF Abstract BibTeX arXiv:2406.12507

Code (1)

mlgig/xai4mtsc_eval_actionability 공식 구현 pytorch

Tasks

channel selectionTime SeriesTime Series Classification

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically
Focus 설명 없음
SHAP 설명 없음

Similar Papers 제목 키워드 기반

From Plausible to Actionable: A Position on LLM Self-Explanations

2026-07-17 · Elize Herrewijnen, Benedetta Muscato, Gizem Gezici, Fosca Giannotti arxiv

Large Language Models (LLMs) can generate natural language explanations that rationalize their own decisions, a phenomenon commonly referred to as self-explanations. Such explanations have emerged as a promising directio…

Evaluating Explanation Methods for Multivariate Time Series Classification

2023-08-29 · Davide Italo Serramazza, Thu Trang Nguyen, Thach Le Nguyen, Georgiana Ifrim

Multivariate time series classification is an important computational task arising in applications where data is recorded over time and over multiple channels. For example, a smartwatch can record the acceleration and or…

ClassificationTime SeriesTime Series AnalysisTime Series Classification

iLLuMinaTE: An LLM-XAI Framework Leveraging Social Science Explanation Theories Towards Actionable Student Performance Feedback

2024-09-12 · Vinitra Swamy, Davide Romano, Bhargav Srinivasa Desikan, Oana-Maria Camburu 외

Recent advances in eXplainable AI (XAI) for education have highlighted a critical challenge: ensuring that explanations for state-of-the-art AI models are understandable for non-technical users such as educators and stud…

Convex optimization for actionable \& plausible counterfactual explanations

2021-05-17 · André Artelt, Barbara Hammer

Transparency is an essential requirement of machine learning based decision making systems that are deployed in real world. Often, transparency of a given system is achieved by providing explanations of the behavior and …

counterfactualDecision Making

Why am I Still Seeing This: Measuring the Effectiveness Of Ad Controls and Explanations in AI-Mediated Ad Targeting Systems

2024-08-21 · Jane Castleman, Aleksandra Korolova

Recently, Meta has shifted towards AI-mediated ad targeting mechanisms that do not require advertisers to provide detailed targeting criteria, likely driven by excitement over AI capabilities as well as new data privacy …