Temporal Convolutional Attention Neural Networks for Time Series Forecasting
Temporal Convolutional Neural Networks (TCNNs) have been applied for various sequence modelling tasks including time series forecasting. However, TCNNs may require many convolutional layers if the input sequence is long and are not able to provide interpretable results. In this paper, we present TCAN, a novel deep learning approach that employs attention mechanism with temporal convolutions for probabilistic forecasting, and demonstrate its performance in a case study for solar power forecasting. TCAN uses the hierarchical convolutional structure of TCNN to extract temporal dependencies and then uses sparse attention to focus on the important timesteps. The sparse attention layer of TCAN enables an extended receptive field without requiring a deeper architecture and allows for interpretability of the forecasting results. An evaluation using three large solar power data sets demonstrates that TCAN outperforms several state-of-the-art deep learning forecasting models including TCNN in terms of accuracy. TCAN requires less number of convolutional layers than TCNN for an extended receptive field, is faster to train and is able to visualize the most important timesteps for the prediction.
Code (1)
Tasks
Multivariate Time Series ForecastingProbabilistic Time Series ForecastingTime SeriesTime Series AnalysisTime Series ForecastingSimilar Papers 제목 키워드 기반
DSANet: Dual Self-Attention Network for Multivariate Time Series Forecasting
Multivariate time series forecasting has attracted wide attention in areas, such as system, traffic, and finance. The difficulty of the task lies in that traditional methods fail to capture complicated nonlinear dependen…
Multivariate Time Series ForecastingTime SeriesTime Series AnalysisTime Series ForecastingPatch-Level Tokenization with CNN Encoders and Attention for Improved Transformer Time-Series Forecasting
Transformer-based models have shown strong performance in time-series forecasting by leveraging self-attention to model long-range temporal dependencies. However, their effectiveness depends critically on the quality and…
Representation LearningTemporal Attention Evolutional Graph Convolutional Network for Multivariate Time Series Forecasting
Multivariate time series forecasting enables the prediction of future states by leveraging historical data, thereby facilitating decision-making processes. Each data node in a multivariate time series encompasses a seque…
Multivariate Time Series ForecastingPredictionTime SeriesTime Series ForecastingEfficient Deterministic Renewable Energy Forecasting Guided by Multiple-Location Weather Data
Electricity generated from renewable energy sources has been established as an efficient remedy for both energy shortages and the environmental pollution stemming from conventional energy production methods. Solar and wi…
Time SeriesTime Series ForecastingESGCN: Edge Squeeze Attention Graph Convolutional Network for Traffic Flow Forecasting
Traffic forecasting is a highly challenging task owing to the dynamical spatio-temporal dependencies of traffic flows. To handle this, we focus on modeling the spatio-temporal dynamics and propose a network termed Edge S…
Time Series