Inference of High-dimensional Autoregressive Generalized Linear Models
Vector autoregressive models characterize a variety of time series in which linear combinations of current and past observations can be used to accurately predict future observations. For instance, each element of an observation vector could correspond to a different node in a network, and the parameters of an autoregressive model would correspond to the impact of the network structure on the time series evolution. Often these models are used successfully in practice to learn the structure of social, epidemiological, financial, or biological neural networks. However, little is known about statistical guarantees on estimates of such models in non-Gaussian settings. This paper addresses the inference of the autoregressive parameters and associated network structure within a generalized linear model framework that includes Poisson and Bernoulli autoregressive processes. At the heart of this analysis is a sparsity-regularized maximum likelihood estimator. While sparsity-regularization is well-studied in the statistics and machine learning communities, those analysis methods cannot be applied to autoregressive generalized linear models because of the correlations and potential heteroscedasticity inherent in the observations. Sample complexity bounds are derived using a combination of martingale concentration inequalities and modern empirical process techniques for dependent random variables. These bounds, which are supported by several simulation studies, characterize the impact of various network parameters on estimator performance.
Code (0)
등록된 구현이 없습니다.
Tasks
Time SeriesTime Series AnalysisVocal Bursts Intensity PredictionSimilar Papers 제목 키워드 기반
On Statistical Inference for High-Dimensional Binary Time Series
The analysis of non-real-valued data, such as binary time series, has attracted great interest in recent years. This manuscript proposes a post-selection estimator for estimating the coefficient matrices of a high-dimens…
Sparse High-Dimensional Vector Autoregressive Bootstrap
We introduce a high-dimensional multiplier bootstrap for time series data based on capturing dependence through a sparsely estimated vector autoregressive model. We prove its consistency for inference on high-dimensional…
Time SeriesTime Series AnalysisVocal Bursts Intensity PredictionLLMs as High-Dimensional Nonlinear Autoregressive Models with Attention: Training, Alignment and Inference
Large language models (LLMs) based on transformer architectures are typically described through collections of architectural components and training procedures, obscuring their underlying computational structure. This re…
Reinforcement LearningContinual LearningForecasting wind power - Modeling periodic and non-linear effects under conditional heteroscedasticity
In this article we present an approach that enables joint wind speed and wind power forecasts for a wind park. We combine a multivariate seasonal time varying threshold autoregressive moving average (TVARMA) model with a…
Heterogeneous Transfer Learning for Building High-Dimensional Generalized Linear Models with Disparate Datasets
Development of comprehensive prediction models are often of great interest in many disciplines of science, but datasets with information on all desired features often have small sample sizes. We describe a transfer learn…
Transfer Learning