paper-with-me

Papers

Fast Sparse Group Lasso

2019-12-01 · NeurIPS 2019 12 · Yasutoshi Ida, Yasuhiro Fujiwara, Hisashi Kashima

Sparse Group Lasso is a method of linear regression analysis that finds sparse parameters in terms of both feature groups and individual features. Block Coordinate Descent is a standard approach to obtain the parameters of Sparse Group Lasso, and iteratively updates the parameters for each parameter group. However, as an update of only one parameter group depends on all the parameter groups or data points, the computation cost is high when the number of the parameters or data points is large. This paper proposes a fast Block Coordinate Descent for Sparse Group Lasso. It efficiently skips the updates of the groups whose parameters must be zeros by using the parameters in one group. In addition, it preferentially updates parameters in a candidate group set, which contains groups whose parameters must not be zeros. Theoretically, our approach guarantees the same results as the original Block Coordinate Descent. Experiments show that our algorithm enhances the efficiency of the original algorithm without any loss of accuracy.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

Linear Regression Linear Regression is a method for modelling a relationship between a dependent variable and independent variables. These models can be fit with numerous approaches. The most…

Similar Papers 제목 키워드 기반

Dual feature reduction for the sparse-group lasso and its adaptive variant

2024-05-27 · Fabio Feser, Marina Evangelou

The sparse-group lasso performs both variable and group selection, making simultaneous use of the strengths of the lasso and group lasso. It has found widespread use in genetics, a field that regularly involves the analy…

Classification with Sparse Overlapping Groups

2014-02-18 · Nikhil Rao, Robert Nowak, Christopher Cox, Timothy Rogers

Classification with a sparsity constraint on the solution plays a central role in many high dimensional machine learning applications. In some cases, the features can be grouped together so that entire subsets of feature…

Classificationfeature selectionGeneral ClassificationModel Selection

SIMD-size aware weight regularization for fast neural vocoding on CPU

2022-11-02 · Hiroki Kanagawa, Yusuke Ijima

This paper proposes weight regularization for a faster neural vocoder. Pruning time-consuming DNN modules is a promising way to realize a real-time vocoder on a CPU (e.g. WaveRNN, LPCNet). Regularization that encourages …

CPU

Correlated Feature Selection with Extended Exclusive Group Lasso

2020-02-27 · Yuxin Sun, Benny Chain, Samuel Kaski, John Shawe-Taylor

In many high dimensional classification or regression problems set in a biological context, the complete identification of the set of informative features is often as important as predictive accuracy, since this can prov…

feature selection

GAP Safe Screening Rules for Sparse-Group-Lasso

2016-02-19 · Eugene Ndiaye, Olivier Fercoq, Alexandre Gramfort, Joseph Salmon

In high dimensional settings, sparse structures are crucial for efficiency, either in term of memory, computation or performance. In some contexts, it is natural to handle more refined structures than pure sparsity, such…