High-Dimensional Bernoulli Autoregressive Process with Long-Range Dependence
We consider the problem of estimating the parameters of a multivariate Bernoulli process with auto-regressive feedback in the high-dimensional setting where the number of samples available is much less than the number of parameters. This problem arises in learning interconnections of networks of dynamical systems with spiking or binary-valued data. We allow the process to depend on its past up to a lag $p$, for a general $p \ge 1$, allowing for more realistic modeling in many applications. We propose and analyze an $\ell_1$-regularized maximum likelihood estimator (MLE) under the assumption that the parameter tensor is approximately sparse. Rigorous analysis of such estimators is made challenging by the dependent and non-Gaussian nature of the process as well as the presence of the nonlinearities and multi-level feedback. We derive precise upper bounds on the mean-squared estimation error in terms of the number of samples, dimensions of the process, the lag $p$ and other key statistical properties of the model. The ideas presented can be used in the high-dimensional analysis of regularized $M$-estimators for other sparse nonlinear and non-Gaussian processes with long-range dependence.
Code (0)
등록된 구현이 없습니다.
Tasks
Gaussian ProcessesVocal Bursts Intensity PredictionSimilar Papers 제목 키워드 기반
Mixing Times and Structural Inference for Bernoulli Autoregressive Processes
We introduce a novel multivariate random process producing Bernoulli outputs per dimension, that can possibly formalize binary interactions in various graphical structures and can be used to model opinion dynamics, epide…
Time Series AnalysisInference of High-dimensional Autoregressive Generalized Linear Models
Vector autoregressive models characterize a variety of time series in which linear combinations of current and past observations can be used to accurately predict future observations. For instance, each element of an obs…
Time SeriesTime Series AnalysisVocal Bursts Intensity PredictionOn the Consistency of Maximum Likelihood Estimators for Causal Network Identification
We consider the problem of identifying parameters of a particular class of Markov chains, called Bernoulli Autoregressive (BAR) processes. The structure of any BAR model is encoded by a directed graph. Incoming edges to …
Network IdentificationTask Conditioned Stochastic Subsampling
Deep Learning algorithms are designed to operate on huge volumes of high dimensional data such as images. In order to reduce the volume of data these algorithms must process, we propose a set-based two-stage end-to-end …
image-classificationImage ClassificationImage ReconstructionSet Based Stochastic Subsampling
Deep models are designed to operate on huge volumes of high dimensional data such as images. In order to reduce the volume of data these models must process, we propose a set-based two-stage end-to-end neural subsampling…
feature selectionimage-classificationImage ClassificationImage Reconstruction+1