Benchmarking Counterfactual Interpretability in Deep Learning Models for Time Series Classification
The popularity of deep learning methods in the time series domain boosts interest in interpretability studies, including counterfactual (CF) methods. CF methods identify minimal changes in instances to alter the model predictions. Despite extensive research, no existing work benchmarks CF methods in the time series domain. Additionally, the results reported in the literature are inconclusive due to the limited number of datasets and inadequate metrics. In this work, we redesign quantitative metrics to accurately capture desirable characteristics in CFs. We specifically redesign the metrics for sparsity and plausibility and introduce a new metric for consistency. Combined with validity, generation time, and proximity, we form a comprehensive metric set. We systematically benchmark 6 different CF methods on 20 univariate datasets and 10 multivariate datasets with 3 different classifiers. Results indicate that the performance of CF methods varies across metrics and among different models. Finally, we provide case studies and a guideline for practical usage.
Code (0)
등록된 구현이 없습니다.
Tasks
BenchmarkingcounterfactualTime SeriesTime Series ClassificationSimilar Papers 제목 키워드 기반
M-CELS: Counterfactual Explanation for Multivariate Time Series Data Guided by Learned Saliency Maps
Over the past decade, multivariate time series classification has received great attention. Machine learning (ML) models for multivariate time series classification have made significant strides and achieved impressive s…
ClassificationcounterfactualCounterfactual ExplanationTime Series+1Interactive Counterfactual Generation for Univariate Time Series
We propose an interactive methodology for generating counterfactual explanations for univariate time series data in classification tasks by leveraging 2D projections and decision boundary maps to tackle interpretability …
counterfactualTime SeriesTime Series ClassificationGenFacts-Generative Counterfactual Explanations for Multi-Variate Time Series
Counterfactual explanations aim to enhance model transparency by showing how inputs can be minimally altered to change predictions. For multivariate time series, existing methods often generate counterfactuals that are i…
TX-Gen: Multi-Objective Optimization for Sparse Counterfactual Explanations for Time-Series Classification
In time-series classification, understanding model decisions is crucial for their application in high-stakes domains such as healthcare and finance. Counterfactual explanations, which provide insights by presenting alter…
counterfactualTime SeriesTime Series ClassificationvalidLearning Time Series Counterfactuals via Latent Space Representations
Counterfactual explanations can provide sample-based explanations of features required to modify from the original sample to change the classification result from an undesired state to a desired state; hence it provides …
counterfactualCounterfactual ExplanationTime SeriesTime Series Classification+1