paper-with-me

Papers

On Regularized Sparse Logistic Regression

2023-09-12 · Mengyuan Zhang, Kai Liu

Sparse logistic regression is for classification and feature selection simultaneously. Although many studies have been done to solve $\ell_1$-regularized logistic regression, there is no equivalently abundant work on solving sparse logistic regression with nonconvex regularization term. In this paper, we propose a unified framework to solve $\ell_1$-regularized logistic regression, which can be naturally extended to nonconvex regularization term, as long as certain requirement is satisfied. In addition, we also utilize a different line search criteria to guarantee monotone convergence for various regularization terms. Empirical experiments on binary classification tasks with real-world datasets demonstrate our proposed algorithms are capable of performing classification and feature selection effectively at a lower computational cost.

📄 PDF Abstract BibTeX arXiv:2309.05925

Code (0)

등록된 구현이 없습니다.

Tasks

Binary ClassificationClassificationfeature selectionregression

Methods 이 논문이 사용한 방법론

Feature Selection Feature selection, also known as variable selection, attribute selection or variable subset selection, is the process of selecting a subset of relevant features (variables,…
Logistic Regression Logistic Regression, despite its name, is a linear model for classification rather than regression. Logistic regression is also known in the literature as logit regression,…

Similar Papers 제목 키워드 기반

Graph-Sparse Logistic Regression

2017-12-15 · Alexander LeNail, Ludwig Schmidt, Johnathan Li, Tobias Ehrenberger 외

We introduce Graph-Sparse Logistic Regression, a new algorithm for classification for the case in which the support should be sparse but connected on a graph. We val- idate this algorithm against synthetic data and bench…

General Classificationregression

Sparse Private LASSO Logistic Regression

2023-04-24 · Amol Khanna, Fred Lu, Edward Raff, Brian Testa

LASSO regularized logistic regression is particularly useful for its built-in feature selection, allowing coefficients to be removed from deployment and producing sparse solutions. Differentially private versions of LASS…

feature selectionModel Selectionregression

A Safe Screening Rule for Sparse Logistic Regression

2013-07-16 · NeurIPS 2014 12 · Jie Wang, Jiayu Zhou, Jun Liu, Peter Wonka 외

The l1-regularized logistic regression (or sparse logistic regression) is a widely used method for simultaneous classification and feature selection. Although many recent efforts have been devoted to its efficient implem…

feature selectionregression

A multilevel framework for sparse optimization with application to inverse covariance estimation and logistic regression

2016-07-01 · Eran Treister, Javier S. Turek, Irad Yavneh

Solving l1 regularized optimization problems is common in the fields of computational biology, signal processing and machine learning. Such l1 regularization is utilized to find sparse minimizers of convex functions. A w…

regression

The Impact of Regularization on High-dimensional Logistic Regression

2019-06-10 · NeurIPS 2019 12 · Fariborz Salehi, Ehsan Abbasi, Babak Hassibi

Logistic regression is commonly used for modeling dichotomous outcomes. In the classical setting, where the number of observations is much larger than the number of parameters, properties of the maximum likelihood estima…

regressionVocal Bursts Intensity Prediction