A Distance Correlation-Based Approach to Characterize the Effectiveness of Recurrent Neural Networks for Time Series Forecasting
Time series forecasting has received a lot of attention, with recurrent neural networks (RNNs) being one of the widely used models due to their ability to handle sequential data. Previous studies on RNN time series forecasting, however, show inconsistent outcomes and offer few explanations for performance variations among the datasets. In this paper, we provide an approach to link time series characteristics with RNN components via the versatile metric of distance correlation. This metric allows us to examine the information flow through the RNN activation layers to be able to interpret and explain their performance. We empirically show that the RNN activation layers learn the lag structures of time series well. However, they gradually lose this information over the span of a few consecutive layers, thereby worsening the forecast quality for series with large lag structures. We also show that the activation layers cannot adequately model moving average and heteroskedastic time series processes. Last, we generate heatmaps for visual comparisons of the activation layers for different choices of the network hyperparameters to identify which of them affect the forecast performance. Our findings can, therefore, aid practitioners in assessing the effectiveness of RNNs for given time series data without actually training and evaluating the networks.
Code (0)
등록된 구현이 없습니다.
Tasks
Time SeriesTime Series ForecastingSimilar Papers 제목 키워드 기반
Modified Computation of Correlation Integral for Analyzing Epileptic Signals
Epilepsy is a chronic neurological disorder characterized by recurrent seizures. One method for analyzing seizure activity is to compute the correlation dimension of time-series electroencephalographic signals. The Grass…
Time SeriesTime Series AnalysisDMGCRN: Dynamic Multi-Graph Convolution Recurrent Network for Traffic Forecasting
Traffic forecasting is a problem of intelligent transportation systems (ITS) and crucial for individuals and public agencies. Therefore, researches pay great attention to deal with the complex spatio-temporal dependencie…
Learning Time-aware Graph Structures for Spatially Correlated Time Series Forecasting
Spatio-temporal forecasting of future values of spatially correlated time series is important across many cyber-physical systems (CPS). Recent studies offer evidence that the use of graph neural networks to capture laten…
Contrastive LearningCorrelated Time Series ForecastingGraph structure learningSelf-Learning+3High-Dimensional Independence Testing via Maximum and Average Distance Correlations
This paper investigates the utilization of maximum and average distance correlations for multivariate independence testing. We characterize their consistency properties in high-dimensional settings with respect to the nu…
validVocal Bursts Intensity PredictionModeling Aspect Correlation for Aspect-based Sentiment Analysis via Recurrent Inverse Learning Guidance
Aspect-based sentiment analysis (ABSA) aims to distinguish sentiment polarity of every specific aspect in a given sentence. Previous researches have realized the importance of interactive learning with context and aspect…
Aspect-Based Sentiment AnalysisAspect-Based Sentiment Analysis (ABSA)SentenceSentiment Analysis