paper-with-me

홈 › Papers

Efficient Path Algorithms for Clustered Lasso and OSCAR

2020-06-16 · Atsumori Takahashi, Shunichi Nomura

In high dimensional regression, feature clustering by their effects on outcomes is often as important as feature selection. For that purpose, clustered Lasso and octagonal shrinkage and clustering algorithm for regression (OSCAR) are used to make feature groups automatically by pairwise $L_1$ norm and pairwise $L_\infty$ norm, respectively. This paper proposes efficient path algorithms for clustered Lasso and OSCAR to construct solution paths with respect to their regularization parameters. Despite too many terms in exhaustive pairwise regularization, their computational costs are reduced by using symmetry of those terms. Simple equivalent conditions to check subgradient equations in each feature group are derived by some graph theories. The proposed algorithms are shown to be more efficient than existing algorithms in numerical experiments.

📄 PDF Abstract BibTeX arXiv:2006.08965

Code (0)

등록된 구현이 없습니다.

Tasks

Clusteringfeature selectionregression

Methods 이 논문이 사용한 방법론

OSCAR OSCAR is a new learning method that uses object tags detected in images as anchor points to ease the learning of image-text alignment. The model take a triple as input…

Similar Papers 제목 키워드 기반

Efficient sparse semismooth Newton methods for the clustered lasso problem

2018-08-22 · Meixia Lin, Yong-Jin Liu, Defeng Sun, Kim-Chuan Toh

We focus on solving the clustered lasso problem, which is a least squares problem with the $\ell_1$-type penalties imposed on both the coefficients and their pairwise differences to learn the group structure of the regre…

On the Duality between Network Flows and Network Lasso

2019-10-04 · Alexander Jung

Many applications generate data with an intrinsic network structure such as time series data, image data or social network data. The network Lasso (nLasso) has been proposed recently as a method for joint clustering and …

ClusteringTime SeriesTime Series Analysis

Group-sparse Matrix Recovery

2014-02-20 · Xiangrong Zeng, Mário A. T. Figueiredo

We apply the OSCAR (octagonal selection and clustering algorithms for regression) in recovering group-sparse matrices (two-dimensional---2D---arrays) from compressive measurements. We propose a 2D version of OSCAR (2OSCA…

Clusteringregression

Majorization-Minimization Dual Stagewise Algorithm for Generalized Lasso

2025-01-04 · Jianmin Chen, Kun Chen

The generalized lasso is a natural generalization of the celebrated lasso approach to handle structural regularization problems. Many important methods and applications fall into this framework, including fused lasso, cl…

Computational Efficiency

An Exact Solution Path Algorithm for SLOPE and Quasi-Spherical OSCAR

2020-10-29 · Shunichi Nomura

Sorted $L_1$ penalization estimator (SLOPE) is a regularization technique for sorted absolute coefficients in high-dimensional regression. By arbitrarily setting its regularization weights $\lambda$ under the monotonicit…

Clusteringfeature selectionregression