paper-with-me

홈 › Papers

Spatiotemporal Covariance Neural Networks

2024-09-16 · Andrea Cavallo, Mohammad Sabbaqi, Elvin Isufi

Modeling spatiotemporal interactions in multivariate time series is key to their effective processing, but challenging because of their irregular and often unknown structure. Statistical properties of the data provide useful biases to model interdependencies and are leveraged by correlation and covariance-based networks as well as by processing pipelines relying on principal component analysis (PCA). However, PCA and its temporal extensions suffer instabilities in the covariance eigenvectors when the corresponding eigenvalues are close to each other, making their application to dynamic and streaming data settings challenging. To address these issues, we exploit the analogy between PCA and graph convolutional filters to introduce the SpatioTemporal coVariance Neural Network (STVNN), a relational learning model that operates on the sample covariance matrix of the time series and leverages joint spatiotemporal convolutions to model the data. To account for the streaming and non-stationary setting, we consider an online update of the parameters and sample covariance matrix. We prove the STVNN is stable to the uncertainties introduced by these online estimations, thus improving over temporal PCA-based methods. Experimental results corroborate our theoretical findings and show that STVNN is competitive for multivariate time series processing, it adapts to changes in the data distribution, and it is orders of magnitude more stable than online temporal PCA.

📄 PDF Abstract BibTeX arXiv:2409.10068

Code (1)

andrea-cavallo-98/STVNN 공식 구현 pytorch

Tasks

Relational ReasoningTime Series

Methods 이 논문이 사용한 방법론

PCA Principle Components Analysis (PCA) is an unsupervised method primary used for dimensionality reduction within machine learning. PCA is calculated via a singular value…

Similar Papers 제목 키워드 기반

Non-separable Covariance Kernels for Spatiotemporal Gaussian Processes based on a Hybrid Spectral Method and the Harmonic Oscillator

2023-02-19 · Dionissios T. Hristopulos

Gaussian processes provide a flexible, non-parametric framework for the approximation of functions in high-dimensional spaces. The covariance kernel is the main engine of Gaussian processes, incorporating correlations th…

Computational EfficiencyGaussian Processes

Kronecker PCA Based Spatio-Temporal Modeling of Video for Dismount Classification

2014-05-19 · Kristjan H. Greenewald, Alfred O. Hero III

We consider the application of KronPCA spatio-temporal modeling techniques [Greenewald et al 2013, Tsiligkaridis et al 2013] to the extraction of spatiotemporal features for video dismount classification. KronPCA perform…

ClassificationDimensionality ReductionGender ClassificationGeneral Classification

CNN-based Realized Covariance Matrix Forecasting

2021-07-22 · Yanwen Fang, Philip L. H. Yu, Yaohua Tang

It is well known that modeling and forecasting realized covariance matrices of asset returns play a crucial role in the field of finance. The availability of high frequency intraday data enables the modeling of the reali…

Scalable Spatiotemporally Varying Coefficient Modelling with Bayesian Kernelized Tensor Regression

2021-08-31 · MengYing Lei, Aurelie Labbe, Lijun Sun

As a regression technique in spatial statistics, the spatiotemporally varying coefficient model (STVC) is an important tool for discovering nonstationary and interpretable response-covariate associations over both space …

regression

Probabilistic Spatiotemporal Modeling of Day-Ahead Wind Power Generation with Input-Warped Gaussian Processes

2024-09-10 · Qiqi Li, Mike Ludkovski

We design a Gaussian Process (GP) spatiotemporal model to capture features of day-ahead wind power forecasts. We work with hourly-scale day-ahead forecasts across hundreds of wind farm locations, with the main aim of con…

Gaussian Processes