paper-with-me

홈 › Papers

$\ell_1$-Regularized Generalized Least Squares

2024-05-17 · Kaveh S. Nobari, Alex Gibberd

In this paper we propose an $\ell_1$-regularized GLS estimator for high-dimensional regressions with potentially autocorrelated errors. We establish non-asymptotic oracle inequalities for estimation accuracy in a framework that allows for highly persistent autoregressive errors. In practice, the Whitening matrix required to implement the GLS is unkown, we present a feasible estimator for this matrix, derive consistency results and ultimately show how our proposed feasible GLS can recover closely the optimal performance (as if the errors were a white noise) of the LASSO. A simulation study verifies the performance of the proposed method, demonstrating that the penalized (feasible) GLS-LASSO estimator performs on par with the LASSO in the case of white noise errors, whilst outperforming it in terms of sign-recovery and estimation error when the errors exhibit significant correlation.

📄 PDF Abstract BibTeX arXiv:2405.10719

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Generalized Kernel Regularized Least Squares

2022-09-28 · Qing Chang, Max Goplerud

Kernel Regularized Least Squares (KRLS) is a popular method for flexibly estimating models that may have complex relationships between variables. However, its usefulness to many researchers is limited for two reasons. Fi…

An LiGME Regularizer of Designated Isolated Minimizers -- An Application to Discrete-Valued Signal Estimation

2025-03-13 · Satoshi Shoji, Wataru Yata, Keita Kume, Isao Yamada

For a regularized least squares estimation of discrete-valued signals, we propose a Linearly involved Generalized Moreau Enhanced (LiGME) regularizer, as a nonconvex regularizer, of designated isolated minimizers. The pr…

Beyond Least-Squares: Fast Rates for Regularized Empirical Risk Minimization through Self-Concordance

2019-02-08 · Ulysse Marteau-Ferey, Dmitrii Ostrovskii, Francis Bach, Alessandro Rudi

We consider learning methods based on the regularization of a convex empirical risk by a squared Hilbertian norm, a setting that includes linear predictors and non-linear predictors through positive-definite kernels. In …

regression

Dynamic Sasvi: Strong Safe Screening for Norm-Regularized Least Squares

2021-02-08 · NeurIPS 2021 12 · Hiroaki Yamada, Makoto Yamada

A recently introduced technique for a sparse optimization problem called "safe screening" allows us to identify irrelevant variables in the early stage of optimization. In this paper, we first propose a flexible framewor…

Deep Regularized Compound Gaussian Network for Solving Linear Inverse Problems

2023-11-28 · Carter Lyons, Raghu G. Raj, Margaret Cheney

Incorporating prior information into inverse problems, e.g. via maximum-a-posteriori estimation, is an important technique for facilitating robust inverse problem solutions. In this paper, we devise two novel approaches …

Compressive SensingImage Reconstruction