paper-with-me

홈 › Papers

Adaptive Principal Component Regression with Applications to Panel Data

2023-07-03 · NeurIPS 2023 11 · Anish Agarwal, Keegan Harris, Justin Whitehouse, Zhiwei Steven Wu

Principal component regression (PCR) is a popular technique for fixed-design error-in-variables regression, a generalization of the linear regression setting in which the observed covariates are corrupted with random noise. We provide the first time-uniform finite sample guarantees for (regularized) PCR whenever data is collected adaptively. Since the proof techniques for analyzing PCR in the fixed design setting do not readily extend to the online setting, our results rely on adapting tools from modern martingale concentration to the error-in-variables setting. We demonstrate the usefulness of our bounds by applying them to the domain of panel data, a ubiquitous setting in econometrics and statistics. As our first application, we provide a framework for experiment design in panel data settings when interventions are assigned adaptively. Our framework may be thought of as a generalization of the synthetic control and synthetic interventions frameworks, where data is collected via an adaptive intervention assignment policy. Our second application is a procedure for learning such an intervention assignment policy in a setting where units arrive sequentially to be treated. In addition to providing theoretical performance guarantees (as measured by regret), we show that our method empirically outperforms a baseline which does not leverage error-in-variables regression.

📄 PDF Abstract BibTeX arXiv:2307.01357

Code (0)

등록된 구현이 없습니다.

Tasks

Econometricsregression

Methods 이 논문이 사용한 방법론

Linear Regression Linear Regression is a method for modelling a relationship between a dependent variable and independent variables. These models can be fit with numerous approaches. The most…

Similar Papers 제목 키워드 기반

Sparse principal component regression with adaptive loading

2014-02-26 · Shuichi. Kawano, Hironori Fujisawa, Toyoyuki Takada, Toshihiko Shiroishi

Principal component regression (PCR) is a two-stage procedure that selects some principal components and then constructs a regression model regarding them as new explanatory variables. Note that the principal components …

regression

Highly Adaptive Principal Component Regression

2026-02-11 · Mingxun Wang, Alejandro Schuler, Mark van der Laan, Carlos García Meixide arxiv

The Highly Adaptive Lasso (HAL) is a nonparametric regression method that achieves almost dimension-free convergence rates under minimal smoothness assumptions, but its implementation can be computationally prohibitive i…

Factor-Driven Two-Regime Regression

2020-09-10

We propose a novel two-regime regression model where regime switching is driven by a vector of possibly unobservable factors. When the factors are latent, we estimate them by the principal component analysis of a panel d…

regressionTime SeriesTime Series AnalysisVocal Bursts Valence Prediction

Bridging factor and sparse models

2021-02-22 · Jianqing Fan, Ricardo Masini, Marcelo C. Medeiros

Factor and sparse models are two widely used methods to impose a low-dimensional structure in high-dimensions. However, they are seemingly mutually exclusive. We propose a lifting method that combines the merits of these…

Model SelectionregressionTime Series Analysis

Multi-adaptive Natural Language Generation using Principal Component Regression

2014-06-01 · WS 2014 6 · Dimitra Gkatzia, Helen Hastie, Oliver Lemon
regressionText GenerationTime Series Analysis