paper-with-me

홈 › Papers

Lasso and equivalent quadratic penalized models

2014-01-10 · Stefan Hummelsheim

The least absolute shrinkage and selection operator (lasso) and ridge regression produce usually different estimates although input, loss function and parameterization of the penalty are identical. In this paper we look for ridge and lasso models with identical solution set. It turns out, that the lasso model with shrink vector $\lambda$ and a quadratic penalized model with shrink matrix as outer product of $\lambda$ with itself are equivalent, in the sense that they have equal solutions. To achieve this, we have to restrict the estimates to be positive. This doesn't limit the area of application since we can easily decompose every estimate in a positive and negative part. The resulting problem can be solved with a non negative least square algorithm. Beside this quadratic penalized model, an augmented regression model with positive bounded estimates is developed which is also equivalent to the lasso model, but is probably faster to solve.

📄 PDF Abstract BibTeX arXiv:1401.2304

Code (0)

등록된 구현이 없습니다.

Tasks

regression

Similar Papers 제목 키워드 기반

Hierarchical Quadratic Random Forest Classifier

2023-06-02 · Faezeh Fallah

In this paper, we proposed a hierarchical quadratic random forest classifier for classifying multiresolution samples extracted from multichannel data. This forest incorporated a penalized multivariate linear discriminant…

A Fast and Scalable Pathwise-Solver for Group Lasso and Elastic Net Penalized Regression via Block-Coordinate Descent

2024-05-14 · James Yang, Trevor Hastie

We develop fast and scalable algorithms based on block-coordinate descent to solve the group lasso and the group elastic net for generalized linear models along a regularization path. Special attention is given when the …

Statistical inference for high dimensional regression via Constrained Lasso

2017-04-17 · Yun Yang

In this paper, we propose a new method for estimation and constructing confidence intervals for low-dimensional components in a high-dimensional model. The proposed estimator, called Constrained Lasso (CLasso) estimator,…

regressionVocal Bursts Intensity Prediction

Heavy Lasso: sparse penalized regression under heavy-tailed noise via data-augmented soft-thresholding

2025-06-09 · The Tien Mai

High-dimensional linear regression is a fundamental tool in modern statistics, particularly when the number of predictors exceeds the sample size. The classical Lasso, which relies on the squared loss, performs well unde…

Data Augmentation

The non-overlapping statistical approximation to overlapping group lasso

2022-11-16 · Mingyu Qi, Tianxi Li

Group lasso is a commonly used regularization method in statistical learning in which parameters are eliminated from the model according to predefined groups. However, when the groups overlap, optimizing the group lasso …