paper-with-me

홈 › Papers

An error bound for Lasso and Group Lasso in high dimensions

2019-12-21 · Antoine Dedieu

We leverage recent advances in high-dimensional statistics to derive new L2 estimation upper bounds for Lasso and Group Lasso in high-dimensions. For Lasso, our bounds scale as $(k^*/n) \log(p/k^*)$---$n\times p$ is the size of the design matrix and $k^*$ the dimension of the ground truth $\boldsymbol{\beta}^*$---and match the optimal minimax rate. For Group Lasso, our bounds scale as $(s^*/n) \log\left( G / s^* \right) + m^* / n$---$G$ is the total number of groups and $m^*$ the number of coefficients in the $s^*$ groups which contain $\boldsymbol{\beta}^*$---and improve over existing results. We additionally show that when the signal is strongly group-sparse, Group Lasso is superior to Lasso.

📄 PDF Abstract BibTeX arXiv:1912.11398

Code (0)

등록된 구현이 없습니다.

Tasks

Vocal Bursts Intensity Prediction

Similar Papers 제목 키워드 기반

Classification with Sparse Overlapping Groups

2014-02-18 · Nikhil Rao, Robert Nowak, Christopher Cox, Timothy Rogers

Classification with a sparsity constraint on the solution plays a central role in many high dimensional machine learning applications. In some cases, the features can be grouped together so that entire subsets of feature…

Classificationfeature selectionGeneral ClassificationModel Selection

Near-Ideal Behavior of Compressed Sensing Algorithms

2014-01-26 · Mehmet Eren Ahsen, Mathukumalli Vidyasagar

In a recent paper, it is shown that the LASSO algorithm exhibits "near-ideal behavior," in the following sense: Suppose $y = Az + \eta$ where $A$ satisfies the restricted isometry property (RIP) with a sufficiently small…

compressed sensing

The non-overlapping statistical approximation to overlapping group lasso

2022-11-16 · Mingyu Qi, Tianxi Li

Group lasso is a commonly used regularization method in statistical learning in which parameters are eliminated from the model according to predefined groups. However, when the groups overlap, optimizing the group lasso …

Error Bounds for Generalized Group Sparsity

2020-08-08 · Xin-Yu Zhang

In high-dimensional statistical inference, sparsity regularizations have shown advantages in consistency and convergence rates for coefficient estimation. We consider a generalized version of Sparse-Group Lasso which cap…

Error Bounds for Compressed Sensing Algorithms With Group Sparsity: A Unified Approach

2015-12-29 · M. Eren Ahsen, M. Vidyasagar

In compressed sensing, in order to recover a sparse or nearly sparse vector from possibly noisy measurements, the most popular approach is $\ell_1$-norm minimization. Upper bounds for the $\ell_2$- norm of the error betw…

compressed sensing