Leveraging Multivariate Long-Term History Representation for Time Series Forecasting
Multivariate Time Series (MTS) forecasting has a wide range of applications in both industry and academia. Recent advances in Spatial-Temporal Graph Neural Network (STGNN) have achieved great progress in modelling spatial-temporal correlations. Limited by computational complexity, most STGNNs for MTS forecasting focus primarily on short-term and local spatial-temporal dependencies. Although some recent methods attempt to incorporate univariate history into modeling, they still overlook crucial long-term spatial-temporal similarities and correlations across MTS, which are essential for accurate forecasting. To fill this gap, we propose a framework called the Long-term Multivariate History Representation (LMHR) Enhanced STGNN for MTS forecasting. Specifically, a Long-term History Encoder (LHEncoder) is adopted to effectively encode the long-term history into segment-level contextual representations and reduce point-level noise. A non-parametric Hierarchical Representation Retriever (HRetriever) is designed to include the spatial information in the long-term spatial-temporal dependency modelling and pick out the most valuable representations with no additional training. A Transformer-based Aggregator (TAggregator) selectively fuses the sparsely retrieved contextual representations based on the ranking positional embedding efficiently. Experimental results demonstrate that LMHR outperforms typical STGNNs by 10.72% on the average prediction horizons and state-of-the-art methods by 4.12% on several real-world datasets. Additionally, it consistently improves prediction accuracy by 9.8% on the top 10% of rapidly changing patterns across the datasets.
Code (0)
등록된 구현이 없습니다.
Tasks
Graph Neural NetworkTime SeriesTime Series ForecastingMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Multiscale Representation Enhanced Temporal Flow Fusion Model for Long-Term Workload Forecasting
Accurate workload forecasting is critical for efficient resource management in cloud computing systems, enabling effective scheduling and autoscaling. Despite recent advances with transformer-based forecasting models, ch…
Cloud ComputingManagementRepresentation LearningScheduling+1A Comparative Study of Transformer-Based Models for Multi-Horizon Blood Glucose Prediction
Accurate blood glucose prediction can enable novel interventions for type 1 diabetes treatment, including personalized insulin and dietary adjustments. Although recent advances in transformer-based architectures have dem…
PredictionTime SeriesTime Series PredictionPre-training Enhanced Spatial-temporal Graph Neural Network for Multivariate Time Series Forecasting
Multivariate Time Series (MTS) forecasting plays a vital role in a wide range of applications. Recently, Spatial-Temporal Graph Neural Networks (STGNNs) have become increasingly popular MTS forecasting methods. STGNNs jo…
Graph Neural NetworkMultivariate Time Series ForecastingTime SeriesTime Series Analysis+2Integrating Quantum-Classical Attention in Patch Transformers for Enhanced Time Series Forecasting
QCAAPatchTF is a quantum attention network integrated with an advanced patch-based transformer, designed for multivariate time series forecasting, classification, and anomaly detection. Leveraging quantum superpositions,…
Anomaly DetectionMultivariate Time Series ForecastingTime SeriesTime Series ForecastingCollaborative learning of common latent representations in routinely collected multivariate ICU physiological signals
In Intensive Care Units (ICU), the abundance of multivariate time series presents an opportunity for machine learning (ML) to enhance patient phenotyping. In contrast to previous research focused on electronic health rec…
Collaborative FilteringPatient PhenotypingTime Series