RPMixer: Shaking Up Time Series Forecasting with Random Projections for Large Spatial-Temporal Data
Spatial-temporal forecasting systems play a crucial role in addressing numerous real-world challenges. In this paper, we investigate the potential of addressing spatial-temporal forecasting problems using general time series forecasting models, i.e., models that do not leverage the spatial relationships among the nodes. We propose a all-Multi-Layer Perceptron (all-MLP) time series forecasting architecture called RPMixer. The all-MLP architecture was chosen due to its recent success in time series forecasting benchmarks. Furthermore, our method capitalizes on the ensemble-like behavior of deep neural networks, where each individual block within the network behaves like a base learner in an ensemble model, particularly when identity mapping residual connections are incorporated. By integrating random projection layers into our model, we increase the diversity among the blocks' outputs, thereby improving the overall performance of the network. Extensive experiments conducted on the largest spatial-temporal forecasting benchmark datasets demonstrate that the proposed method outperforms alternative methods, including both spatial-temporal graph models and general forecasting models.
Code (0)
등록된 구현이 없습니다.
Tasks
AllDiversityTime SeriesTime Series ForecastingTraffic PredictionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Ensembles of Randomized NNs for Pattern-based Time Series Forecasting
In this work, we propose an ensemble forecasting approach based on randomized neural networks. Improved randomized learning streamlines the fitting abilities of individual learners by generating network parameters in acc…
DiversityTime SeriesTime Series AnalysisTime Series ForecastingRandomized Neural Networks for Forecasting Time Series with Multiple Seasonality
This work contributes to the development of neural forecasting models with novel randomization-based learning methods. These methods improve the fitting abilities of the neural model, in comparison to the standard method…
Time SeriesTime Series AnalysisTime Series ForecastingBoosted Ensemble Learning based on Randomized NNs for Time Series Forecasting
Time series forecasting is a challenging problem particularly when a time series expresses multiple seasonality, nonlinear trend and varying variance. In this work, to forecast complex time series, we propose ensemble le…
Ensemble LearningTime SeriesTime Series AnalysisTime Series ForecastingGraph Neural Networks for Multivariate Time Series Regression with Application to Seismic Data
Machine learning, with its advances in deep learning has shown great potential in analyzing time series. In many scenarios, however, additional information that can potentially improve the predictions is available. This …
Graph Neural NetworkregressionTime SeriesTime Series Analysis+2Hybrid Variational Autoencoder for Time Series Forecasting
Variational autoencoders (VAE) are powerful generative models that learn the latent representations of input data as random variables. Recent studies show that VAE can flexibly learn the complex temporal dynamics of time…
Time SeriesTime Series AnalysisTime Series ForecastingVariational Inference