An interpretable LSTM neural network for autoregressive exogenous model
In this paper, we propose an interpretable LSTM recurrent neural network, i.e., multi-variable LSTM for time series with exogenous variables. Currently, widely used attention mechanism in recurrent neural networks mostly focuses on the temporal aspect of data and falls short of characterizing variable importance. To this end, our multi-variable LSTM equipped with tensorized hidden states is developed to learn variable specific representations, which give rise to both temporal and variable level attention. Preliminary experiments demonstrate comparable prediction performance of multi-variable LSTM w.r.t. encoder-decoder based baselines. More interestingly, variable importance in real datasets characterized by the variable attention is highly in line with that determined by statistical Granger causality test, which exhibits the prospect of multi-variable LSTM as a simple and uniform end-to-end framework for both forecasting and knowledge discovery.
Code (0)
등록된 구현이 없습니다.
Tasks
DecoderTime SeriesTime Series AnalysisMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Multi-variable LSTM neural network for autoregressive exogenous model
In this paper, we propose multi-variable LSTM capable of accurate forecasting and variable importance interpretation for time series with exogenous variables. Current attention mechanism in recurrent neural networks most…
Time SeriesTime Series AnalysisIdentification of Switched Autoregressive and Switched Autoregressive Exogenous Systems from Large Noisy Data Sets
The paper introduces novel methodologies for the identification of coefficients of switched autoregressive and switched autoregressive exogenous linear models. We consider cases which system's outputs are contaminated by…
Interpretable Vector AutoRegressions with Exogenous Time Series
The Vector AutoRegressive (VAR) model is fundamental to the study of multivariate time series. Although VAR models are intensively investigated by many researchers, practitioners often show more interest in analyzing VAR…
ManagementMarketingTime SeriesTime Series AnalysisExploring the interpretability of LSTM neural networks over multi-variable data
In learning a predictive model over multivariate time series consisting of target and exogenous variables, the forecasting performance and interpretability of the model are both essential for deployment and uncovering kn…
Time SeriesTime Series AnalysisNational-scale electricity peak load forecasting: Traditional, machine learning, or hybrid model?
As the volatility of electricity demand increases owing to climate change and electrification, the importance of accurate peak load forecasting is increasing. Traditional peak load forecasting has been conducted through …
BIG-bench Machine LearningLoad ForecastingTime SeriesTime Series Analysis