High-Dimensional Multivariate Forecasting with Low-Rank Gaussian Copula Processes
Predicting the dependencies between observations from multiple time series is critical for applications such as anomaly detection, financial risk management, causal analysis, or demand forecasting. However, the computational and numerical difficulties of estimating time-varying and high-dimensional covariance matrices often limits existing methods to handling at most a few hundred dimensions or requires making strong assumptions on the dependence between series. We propose to combine an RNN-based time series model with a Gaussian copula process output model with a low-rank covariance structure to reduce the computational complexity and handle non-Gaussian marginal distributions. This permits to drastically reduce the number of parameters and consequently allows the modeling of time-varying correlations of thousands of time series. We show on several real-world datasets that our method provides significant accuracy improvements over state-of-the-art baselines and perform an ablation study analyzing the contributions of the different components of our model.
Code (2)
Tasks
Anomaly DetectionDemand ForecastingManagementTime SeriesTime Series AnalysisVocal Bursts Intensity PredictionSimilar Papers 제목 키워드 기반
MVG-CRPS: A Robust Loss Function for Multivariate Probabilistic Forecasting
Multivariate Gaussian (MVG) distributions are central to modeling correlated continuous variables in probabilistic forecasting. Neural forecasting models typically parameterize the mean vector and covariance matrix of th…
Probabilistic Time Series Forecastingscoring ruleTime Series ForecastingUncertainty QuantificationMICA: Multivariate Infini Compressive Attention for Time Series Forecasting
Multivariate forecasting with Transformers faces a core scalability challenge: modeling cross-channel dependencies via attention compounds attention's quadratic sequence complexity with quadratic channel scaling, making …
Time Series ForecastingHDT: Hierarchical Discrete Transformer for Multivariate Time Series Forecasting
Generative models have gained significant attention in multivariate time series forecasting (MTS), particularly due to their ability to generate high-fidelity samples. Forecasting the probability distribution of multivar…
Multivariate Time Series ForecastingTime SeriesTime Series Forecastingcs-net: structural approach to time-series forecasting for high-dimensional feature space data with limited observations
In recent years, deep-learning-based approaches have been introduced to solving time-series forecasting-related problems. These novel methods have demonstrated impressive performance in univariate and low-dimensional mul…
GPUMultivariate Time Series ForecastingTime SeriesTime Series Analysis+1Learning Gaussian Mixture Representations for Tensor Time Series Forecasting
Tensor time series (TTS) data, a generalization of one-dimensional time series on a high-dimensional space, is ubiquitous in real-world scenarios, especially in monitoring systems involving multi-source spatio-temporal d…
Representation LearningTime SeriesTime Series Forecasting