paper-with-me

Papers

Semismooth Newton Algorithm for Efficient Projections onto $\ell_{1, \infty}$-norm Ball

2020-01-01 · ICML 2020 1 · Dejun Chu, Chang-Shui Zhang, Shiliang Sun, Qing Tao

Structured sparsity-inducing $\ell_{1, \infty}$-norm, as a generalization of the classical $\ell_1$-norm, plays an important role in jointly sparse models which select or remove simultaneously all the variables forming a group. However, its resulting problem is more difficult to solve than the conventional $\ell_1$-norm constrained problem. In this paper, we propose an efficient algorithm for Euclidean projection onto $\ell_{1, \infty}$-norm ball. We tackle the projection problem via semismooth Newton algorithm to solve the system of semismooth equations. Meanwhile, exploiting the structure of Jacobian matrix via LU decomposition yields an equivalent algorithm which is proved to terminate after a finite number of iterations. Empirical studies demonstrate that our proposed algorithm outperforms the existing state-of-the-art solver and is promising for the optimization of learning problems with $\ell_{1, \infty}$-norm ball constraint.

📄 PDF Abstract BibTeX

Code (1)

djchu/projontol1inf 공식 구현

Similar Papers 제목 키워드 기반

A Stochastic Semismooth Newton Method for Nonsmooth Nonconvex Optimization

2018-03-09 · Andre Milzarek, Xiantao Xiao, Shicong Cen, Zaiwen Wen 외

In this work, we present a globalized stochastic semismooth Newton method for solving stochastic optimization problems involving smooth nonconvex and nonsmooth convex terms in the objective function. We assume that only …

Binary ClassificationStochastic Optimization

A Semismooth-Newton's-Method-Based Linearization and Approximation Approach for Kernel Support Vector Machines

2020-07-21 · Chen Jiang, Qingna Li

Support Vector Machines (SVMs) are among the most popular and the best performing classification algorithms. Various approaches have been proposed to reduce the high computation and memory cost when training and predicti…

Semismooth Newton Coordinate Descent Algorithm for Elastic-Net Penalized Huber Loss Regression and Quantile Regression

2015-09-09 · Congrui Yi, Jian Huang

We propose an algorithm, semismooth Newton coordinate descent (SNCD), for the elastic-net penalized Huber loss regression and quantile regression in high dimensional settings. Unlike existing coordinate descent type algo…

quantile regressionregression

A distributed semismooth Newton based augmented Lagrangian method for distributed optimization

2026-02-27 · Qihao Ma, Chengjing Wang, Peipei Tang, Dunbiao Niu 외 arxiv

This paper proposes a novel distributed semismooth Newton based augmented Lagrangian method for solving a class of optimization problems over networks, where the global objective is defined as the sum of locally held cos…

Distributed Optimization

A sparse semismooth Newton based proximal majorization-minimization algorithm for nonconvex square-root-loss regression problems

2019-03-27 · Peipei Tang, Chengjing Wang, Defeng Sun, Kim-Chuan Toh

In this paper, we consider high-dimensional nonconvex square-root-loss regression problems and introduce a proximal majorization-minimization (PMM) algorithm for these problems. Our key idea for making the proposed PMM t…

regression