paper-with-me

Papers

Sparse estimation via $\ell_q$ optimization method in high-dimensional linear regression

2019-11-12 · Xin Li, Yaohua Hu, Chong Li, Xiaoqi Yang, Tianzi Jiang

In this paper, we discuss the statistical properties of the $\ell_q$ optimization methods $(0<q\leq 1)$, including the $\ell_q$ minimization method and the $\ell_q$ regularization method, for estimating a sparse parameter from noisy observations in high-dimensional linear regression with either a deterministic or random design. For this purpose, we introduce a general $q$-restricted eigenvalue condition (REC) and provide its sufficient conditions in terms of several widely-used regularity conditions such as sparse eigenvalue condition, restricted isometry property, and mutual incoherence property. By virtue of the $q$-REC, we exhibit the stable recovery property of the $\ell_q$ optimization methods for either deterministic or random designs by showing that the $\ell_2$ recovery bound $O(\epsilon^2)$ for the $\ell_q$ minimization method and the oracle inequality and $\ell_2$ recovery bound $O(\lambda^{\frac{2}{2-q}}s)$ for the $\ell_q$ regularization method hold respectively with high probability. The results in this paper are nonasymptotic and only assume the weak $q$-REC. The preliminary numerical results verify the established statistical property and demonstrate the advantages of the $\ell_q$ regularization method over some existing sparse optimization methods.

📄 PDF Abstract BibTeX arXiv:1911.05073

Code (0)

등록된 구현이 없습니다.

Tasks

regressionVocal Bursts Intensity Prediction

Methods 이 논문이 사용한 방법론

Linear Regression Linear Regression is a method for modelling a relationship between a dependent variable and independent variables. These models can be fit with numerous approaches. The most…

Similar Papers 제목 키워드 기반

Sparse high-dimensional linear regression with a partitioned empirical Bayes ECM algorithm

2022-09-16 · Alexander C. McLain, Anja Zgodic, Howard Bondell

Bayesian variable selection methods are powerful techniques for fitting and inferring on sparse high-dimensional linear regression models. However, many are computationally intensive or require restrictive prior distribu…

Prediction IntervalsregressionVariable Selection

Strong oracle optimality of folded concave penalized estimation

2012-10-22 · Jianqing Fan, Lingzhou Xue, Hui Zou

Folded concave penalization methods have been shown to enjoy the strong oracle property for high-dimensional sparse estimation. However, a folded concave penalization problem usually has multiple local solutions and the …

quantile regressionregression

Stochastic Mirror Descent for Large-Scale Sparse Recovery

2022-10-23 · Sasila Ilandarideva, Yannis Bekri, Anatoli Juditsky, Vianney Perchet

In this paper we discuss an application of Stochastic Approximation to statistical estimation of high-dimensional sparse parameters. The proposed solution reduces to resolving a penalized stochastic optimization problem …

Stochastic Optimization

Sparse Nonlinear Regression: Parameter Estimation and Asymptotic Inference

2015-11-14 · Zhuoran Yang, Zhaoran Wang, Han Liu, Yonina C. Eldar 외

We study parameter estimation and asymptotic inference for sparse nonlinear regression. More specifically, we assume the data are given by $y = f( x^\top \beta^* ) + \epsilon$, where $f$ is nonlinear. To recover $\beta^*…

parameter estimationregressionvalid

sparseGeoHOPCA: A Geometric Solution to Sparse Higher-Order PCA Without Covariance Estimation

2025-06-10 · Renjie Xu, Chong Wu, Maolin Che, Zhuoheng Ran 외

We propose sparseGeoHOPCA, a novel framework for sparse higher-order principal component analysis (SHOPCA) that introduces a geometric perspective to high-dimensional tensor decomposition. By unfolding the input tensor a…

Computational EfficiencyImage ReconstructionTensor Decomposition