paper-with-me

Papers

Least Angle Regression in Tangent Space and LASSO for Generalized Linear Models

2019-07-18 · Yoshihiro Hirose

This study proposes sparse estimation methods for the generalized linear models, which run one of least angle regression (LARS) and least absolute shrinkage and selection operator (LASSO) in the tangent space of the manifold of the statistical model. This study approximates the statistical model and subsequently uses exact calculations. LARS was proposed as an efficient algorithm for parameter estimation and variable selection for the normal linear model. The LARS algorithm is described in terms of Euclidean geometry regarding the correlation as the metric of the parameter space. Since the LARS algorithm only works in Euclidean space, we transform a manifold of the statistical model into the tangent space at the origin. In the generalized linear regression, this transformation allows us to run the original LARS algorithm for the generalized linear models. The proposed methods are efficient and perform well. Real-data analysis indicates that the proposed methods output similar results to that of the $l_1$-regularized maximum likelihood estimation for the aforementioned models. Numerical experiments reveal that our methods work well and they may be better than the $l_1$-regularization in generalization, parameter estimation, and model selection.

📄 PDF Abstract BibTeX arXiv:1907.08100

Code (0)

등록된 구현이 없습니다.

Tasks

Model Selectionparameter estimationregressionVariable Selection

Similar Papers 제목 키워드 기반

When Is the First Spurious Variable Selected by Sequential Regression Procedures?

2017-08-10 · Weijie J. Su

Applied statisticians use sequential regression procedures to produce a ranking of explanatory variables and, in settings of low correlations between variables and strong true effect sizes, expect that variables at the v…

Model Selectionregression

Accuracy and stability of solar variable selection comparison under complicated dependence structures

2020-07-30 · Ning Xu, Timothy C. G. Fisher, Jian Hong

In this paper we focus on the empirical variable-selection peformance of subsample-ordered least angle regression (Solar) -- a novel ultrahigh dimensional redesign of lasso -- on the empirical data with complicated depen…

Graph LearningregressionVariable Selection

Penalty, Shrinkage, and Preliminary Test Estimators under Full Model Hypothesis

2015-03-24 · Enayetur Raheem, A. K. Md. Ehsanes Saleh

This paper considers a multiple regression model and compares, under full model hypothesis, analytically as well as by simulation, the performance characteristics of some popular penalty estimators such as ridge regressi…

regression

On Coresets For Regularized Regression

2020-06-09 · ICML 2020 1 · Rachit Chhaya, Anirban Dasgupta, Supratim Shit

We study the effect of norm based regularization on the size of coresets for regression problems. Specifically, given a matrix $ \mathbf{A} \in {\mathbb{R}}^{n \times d}$ with $n\gg d$ and a vector $\mathbf{b} \in \mathb…

regression

On an improvement of LASSO by scaling

2018-08-22 · Katsuyuki Hagiwara

A sparse modeling is a major topic in machine learning and statistics. LASSO (Least Absolute Shrinkage and Selection Operator) is a popular sparse modeling method while it has been known to yield unexpected large bias es…

Model Selection