Multivariate time series prediction using clustered echo state network
Many natural and physical processes can be understood by analyzing multiple system variables evolving, forming a multivariate time series. Predicting such time series is challenging due to the inherent noise and interdependencies among variables. Echo state networks (ESNs), a class of Reservoir Computing (RC) models, offer an efficient alternative to conventional recurrent neural networks by training only the output weights while keeping the reservoir dynamics fixed, reducing computational complexity. We propose a clustered ESNs (CESNs) that enhances the ability to model and predict multivariate time series by organizing the reservoir nodes into clusters, each corresponding to a distinct input variable. Input signals are directly mapped to their associated clusters, and intra-cluster connections remain dense while inter-cluster connections are sparse, mimicking the modular architecture of biological neural networks. This architecture improves information processing by limiting cross-variable interference and enhances computational efficiency through independent cluster-wise training via ridge regression. We further explore different reservoir topologies, including ring, Erdős-Rényi (ER), and scale-free (SF) networks, to evaluate their impact predictive performance. Our algorithm works well across diverse real-world datasets such as the stock market, solar wind, and chaotic Rössler system, demonstrating that CESNs consistently outperform conventional ESNs in terms of predictive accuracy and robustness to noise, particularly when using ER and SF topologies. These findings highlight the adaptability of CESNs for complex, multivariate time series forecasting.
Code (0)
등록된 구현이 없습니다.
Tasks
Multivariate Time Series ForecastingComputational EfficiencyTime Series PredictionSimilar Papers 제목 키워드 기반
Comparison between DeepESNs and gated RNNs on multivariate time-series prediction
We propose an experimental comparison between Deep Echo State Networks (DeepESNs) and gated Recurrent Neural Networks (RNNs) on multivariate time-series prediction tasks. In particular, we compare reservoir and fully-tra…
PredictionTime SeriesTime Series AnalysisTime Series PredictionStatic Seeding and Clustering of LSTM Embeddings to Learn from Loosely Time-Decoupled Events
Humans learn from the occurrence of events in a different place and time to predict similar trajectories of events. We define Loosely Decoupled Timeseries (LDT) phenomena as two or more events that could happen in differ…
ClusteringA self-organising eigenspace map for time series clustering
This paper presents a novel time series clustering method, the self-organising eigenspace map (SOEM), based on a generalisation of the well-known self-organising feature map (SOFM). The SOEM operates on the eigenspaces o…
ClusteringTime SeriesTime Series AnalysisTime Series Clustering+2Bidirectional deep-readout echo state networks
We propose a deep architecture for the classification of multivariate time series. By means of a recurrent and untrained reservoir we generate a vectorial representation that embeds temporal relationships in the data. To…
ClassificationDimensionality ReductionGeneral ClassificationMemorization+2Autoregressive Convolutional Recurrent Neural Network for Univariate and Multivariate Time Series Prediction
Time Series forecasting (univariate and multivariate) is a problem of high complexity due the different patterns that have to be detected in the input, ranging from high to low frequencies ones. In this paper we propose …
Time SeriesTime Series AnalysisTime Series ForecastingTime Series Prediction