Sparsistent Learning of Varying-coefficient Models with Structural Changes
To estimate the changing structure of a varying-coefficient varying-structure (VCVS) model remains an important and open problem in dynamic system modelling, which includes learning trajectories of stock prices, or uncovering the topology of an evolving gene network. In this paper, we investigate sparsistent learning of a sub-family of this model --- piecewise constant VCVS models. We analyze two main issues in this problem: inferring time points where structural changes occur and estimating model structure (i.e., model selection) on each of the constant segments. We propose a two-stage adaptive procedure, which first identifies jump points of structural changes and then identifies relevant covariates to a response on each of the segments. We provide an asymptotic analysis of the procedure, showing that with the increasing sample size, number of structural changes, and number of variables, the true model can be consistently selected. We demonstrate the performance of the method on synthetic data and apply it to the brain computer interface dataset. We also consider how this applies to structure estimation of time-varying probabilistic graphical models.
Code (0)
등록된 구현이 없습니다.
Tasks
Brain Computer InterfaceModel SelectionSimilar Papers 제목 키워드 기반
Sparsistent Estimation of Time-Varying Discrete Markov Random Fields
Network models have been popular for modeling and representing complex relationships and dependencies between observed variables. When data comes from a dynamic stochastic process, a single static network model cannot ad…
regressionTime SeriesTime Series AnalysisEntrywise Recovery Guarantees for Sparse PCA via Sparsistent Algorithms
Sparse Principal Component Analysis (PCA) is a prevalent tool across a plethora of subfields of applied statistics. While several results have characterized the recovery error of the principal eigenvectors, these are typ…
The Effect of Capital Share on Income Inequality: Identifying the Time Patterns
This study explores the link between the capital share and income inequality over the past four decades across 56 countries. Calculating the capital share from national accounts alongside top income share data from the W…
High-Dimensional Graphical Model Selection: Tractable Graph Families and Necessary Conditions
We consider the problem of Ising and Gaussian graphical model selection given n i.i.d. samples from the model. We propose an efficient threshold-based algorithm for structure estimation based known as conditional mutu…
Model SelectionVocal Bursts Intensity PredictionLarge Hybrid Time-Varying Parameter VARs
Time-varying parameter VARs with stochastic volatility are routinely used for structural analysis and forecasting in settings involving a few endogenous variables. Applying these models to high-dimensional datasets has p…