On LASSO for High Dimensional Predictive Regression
This paper examines LASSO, a widely-used $L_{1}$-penalized regression method, in high dimensional linear predictive regressions, particularly when the number of potential predictors exceeds the sample size and numerous unit root regressors are present. The consistency of LASSO is contingent upon two key components: the deviation bound of the cross product of the regressors and the error term, and the restricted eigenvalue of the Gram matrix. We present new probabilistic bounds for these components, suggesting that LASSO's rates of convergence are different from those typically observed in cross-sectional cases. When applied to a mixture of stationary, nonstationary, and cointegrated predictors, LASSO maintains its asymptotic guarantee if predictors are scale-standardized. Leveraging machine learning and macroeconomic domain expertise, LASSO demonstrates strong performance in forecasting the unemployment rate, as evidenced by its application to the FRED-MD database.
Code (0)
등록된 구현이 없습니다.
Tasks
regressionTime SeriesTime Series AnalysisVocal Bursts Intensity PredictionSimilar Papers 제목 키워드 기반
Econometric Inference for High Dimensional Predictive Regressions
LASSO introduces shrinkage bias into estimated coefficients, which can adversely affect the desirable asymptotic normality and invalidate the standard inferential procedure based on the $t$-statistic. The desparsified LA…
regressionOn LASSO for Predictive Regression
Explanatory variables in a predictive regression typically exhibit low signal strength and various degrees of persistence. Variable selection in such a context is of great importance. In this paper, we explore the pitfal…
regressionVariable SelectionHMLasso: Lasso with High Missing Rate
Sparse regression such as the Lasso has achieved great success in handling high-dimensional data. However, one of the biggest practical problems is that high-dimensional data often contain large amounts of missing values…
Missing ValuesregressionVocal Bursts Intensity PredictionLassoBench: A High-Dimensional Hyperparameter Optimization Benchmark Suite for Lasso
While Weighted Lasso sparse regression has appealing statistical guarantees that would entail a major real-world impact in finance, genomics, and brain imaging applications, it is typically scarcely adopted due to its co…
Bayesian OptimizationHyperparameter OptimizationregressionVocal Bursts Intensity PredictionBayesian MIDAS Penalized Regressions: Estimation, Selection, and Prediction
We propose a new approach to mixed-frequency regressions in a high-dimensional environment that resorts to Group Lasso penalization and Bayesian techniques for estimation and inference. In particular, to improve the pred…
Prediction