Sampling Requirements for Stable Autoregressive Estimation

2016-05-04 · Abbas Kazemipour, Sina Miran, Piya Pal, Behtash Babadi, Min Wu

We consider the problem of estimating the parameters of a linear univariate autoregressive model with sub-Gaussian innovations from a limited sequence of consecutive observations. Assuming that the parameters are compressible, we analyze the performance of the $\ell_1$-regularized least squares as well as a greedy estimator of the parameters and characterize the sampling trade-offs required for stable recovery in the non-asymptotic regime. In particular, we show that for a fixed sparsity level, stable recovery of AR parameters is possible when the number of samples scale sub-linearly with the AR order. Our results improve over existing sampling complexity requirements in AR estimation using the LASSO, when the sparsity level scales faster than the square root of the model order. We further derive sufficient conditions on the sparsity level that guarantee the minimax optimality of the $\ell_1$-regularized least squares estimate. Applying these techniques to simulated data as well as real-world datasets from crude oil prices and traffic speed data confirm our predicted theoretical performance gains in terms of estimation accuracy and model selection.

📄 PDF Abstract BibTeX arXiv:1605.01436

Code (0)

등록된 구현이 없습니다.

Tasks

Model Selection

Methods 이 논문이 사용한 방법론

SPEED The monocular depth estimation (MDE) is the task of estimating depth from a single frame. This information is an essential knowledge in many computer vision tasks such as scene…

MaCow: Masked Convolutional Generative Flow

2019-02-12 · NeurIPS 2019 12 · Xuezhe Ma, Xiang Kong, Shanghang Zhang, Eduard Hovy

Flow-based generative models, conceptually attractive due to tractability of both the exact log-likelihood computation and latent-variable inference, and efficiency of both training and sampling, has led to a number of i…

Computational Efficiency Density Estimation Image Generation

Rollback-Free Stable Brick Structures Generation

2026-05-07 · Chenhui Xu, Ziyue Bai, Fuxun Yu, Heng Huang 외 arxiv

While autoregressive models have advanced 3D generation, creating physically stable brick structures remains a challenge due to the strict requirements of gravity and interconnectivity. Existing approaches rely on extern…

Reinforcement Learning Collision Avoidance 3D Generation

Lag selection and estimation of stable parameters for multiple autoregressive processes through convex programming

2023-03-03 · Somnath Chakraborty, Johannes Lederer, Rainer von Sachs

Motivated by a variety of applications, high-dimensional time series have become an active topic of research. In particular, several methods and finite-sample theories for individual stable autoregressive processes with …

Time Series Time Series Analysis

Autoregressive Score Matching

2020-10-24 · NeurIPS 2020 12 · Chenlin Meng, Lantao Yu, Yang song, Jiaming Song 외

Autoregressive models use chain rule to define a joint probability distribution as a product of conditionals. These conditionals need to be normalized, imposing constraints on the functional families that can be used. To…

Denoising Density Estimation Image Denoising Image Generation

Inference-Time Scaling for Visual AutoRegressive modeling by Searching Representative Samples

2026-01-12 · Weidong Tang, Xinyan Wan, Siyu Li, Xiumei Wang arxiv

While inference-time scaling has significantly enhanced generative quality in large language and diffusion models, its application to vector-quantized (VQ) visual autoregressive modeling (VAR) remains unexplored. We intr…

Density Estimation