An Aggregation Method for Sparse Logistic Regression

2014-10-25 · Zhe Liu

$L_1$ regularized logistic regression has now become a workhorse of data mining and bioinformatics: it is widely used for many classification problems, particularly ones with many features. However, $L_1$ regularization typically selects too many features and that so-called false positives are unavoidable. In this paper, we demonstrate and analyze an aggregation method for sparse logistic regression in high dimensions. This approach linearly combines the estimators from a suitable set of logistic models with different underlying sparsity patterns and can balance the predictive ability and model interpretability. Numerical performance of our proposed aggregation method is then investigated using simulation studies. We also analyze a published genome-wide case-control dataset to further evaluate the usefulness of the aggregation method in multilocus association mapping.

📄 PDF Abstract BibTeX arXiv:1410.6959

Code (0)

등록된 구현이 없습니다.

Tasks

General Classification regression

Methods 이 논문이 사용한 방법론

Logistic Regression Logistic Regression, despite its name, is a linear model for classification rather than regression. Logistic regression is also known in the literature as logit regression,…

A Safe Screening Rule for Sparse Logistic Regression

2013-07-16 · NeurIPS 2014 12 · Jie Wang, Jiayu Zhou, Jun Liu, Peter Wonka 외

The l1-regularized logistic regression (or sparse logistic regression) is a widely used method for simultaneous classification and feature selection. Although many recent efforts have been devoted to its efficient implem…

feature selection regression

Sparse Private LASSO Logistic Regression

2023-04-24 · Amol Khanna, Fred Lu, Edward Raff, Brian Testa

LASSO regularized logistic regression is particularly useful for its built-in feature selection, allowing coefficients to be removed from deployment and producing sparse solutions. Differentially private versions of LASS…

feature selection Model Selection regression

Graph-Sparse Logistic Regression

2017-12-15 · Alexander LeNail, Ludwig Schmidt, Johnathan Li, Tobias Ehrenberger 외

We introduce Graph-Sparse Logistic Regression, a new algorithm for classification for the case in which the support should be sparse but connected on a graph. We val- idate this algorithm against synthetic data and bench…

General Classification regression

On Regularized Sparse Logistic Regression

2023-09-12 · Mengyuan Zhang, Kai Liu

Sparse logistic regression is for classification and feature selection simultaneously. Although many studies have been done to solve $\ell_1$-regularized logistic regression, there is no equivalently abundant work on sol…

Binary Classification Classification feature selection regression

PIANO: A Fast Parallel Iterative Algorithm for Multinomial and Sparse Multinomial Logistic Regression

2020-02-21 · R. Jyothi, P. Babu

Multinomial Logistic Regression is a well-studied tool for classification and has been widely used in fields like image processing, computer vision and, bioinformatics, to name a few. Under a supervised classification sc…