Time-series attribution maps with regularized contrastive learning
Gradient-based attribution methods aim to explain decisions of deep learning models but so far lack identifiability guarantees. Here, we propose a method to generate attribution maps with identifiability guarantees by developing a regularized contrastive learning algorithm trained on time-series data plus a new attribution method called Inverted Neuron Gradient (collectively named xCEBRA). We show theoretically that xCEBRA has favorable properties for identifying the Jacobian matrix of the data generating process. Empirically, we demonstrate robust approximation of zero vs. non-zero entries in the ground-truth attribution map on synthetic datasets, and significant improvements across previous attribution methods based on feature ablation, Shapley values, and other gradient-based methods. Our work constitutes a first example of identifiable inference of time-series attribution maps and opens avenues to a better understanding of time-series data, such as for neural dynamics and decision-processes within neural networks.
Code (1)
Tasks
Contrastive LearningTime SeriesMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Time Series Model Attribution Visualizations as Explanations
Attributions are a common local explanation technique for deep learning models on single samples as they are easily extractable and demonstrate the relevance of input values. In many cases, heatmaps visualize such attrib…
modelPositionTime SeriesTime Series AnalysisTime series saliency maps: explaining models across multiple domains
Traditional saliency map methods, popularized in computer vision, highlight individual points (pixels) of the input that contribute the most to the model's output. However, in time-series they offer limited insights as s…
Explainable Artificial Intelligence (XAI)Interpretability Techniques for Deep LearningPhotoplethysmography (PPG) heart rate estimationSeizure Detection+2CHALLENGER: Training with Attribution Maps
We show that utilizing attribution maps for training neural networks can improve regularization of models and thus increase performance. Regularization is key in deep learning, especially when training complex models on …
Time SeriesTime Series AnalysisIntroducing the Attribution Stability Indicator: a Measure for Time Series XAI Attributions
Given the increasing amount and general complexity of time series data in domains such as finance, weather forecasting, and healthcare, there is a growing need for state-of-the-art performance models that can provide int…
Time SeriesTime Series ClassificationWeather ForecastingTraceBench: Controlled Evaluation of LLM Agents for Time-Series Root-Cause Attribution
LLM agents are increasingly applied to anomaly detection and root-cause analysis in time-series observations collected from real-world systems; however, their performance on these tasks has not been systematically evalua…
Anomaly Detection