paper-with-me

홈 › Papers

A sparse semismooth Newton based augmented Lagrangian method for large-scale support vector machines

2019-10-03 · Dunbiao Niu, Chengjing Wang, Peipei Tang, Qingsong Wang, Enbin Song

Support vector machines (SVMs) are successful modeling and prediction tools with a variety of applications. Previous work has demonstrated the superiority of the SVMs in dealing with the high dimensional, low sample size problems. However, the numerical difficulties of the SVMs will become severe with the increase of the sample size. Although there exist many solvers for the SVMs, only few of them are designed by exploiting the special structures of the SVMs. In this paper, we propose a highly efficient sparse semismooth Newton based augmented Lagrangian method for solving a large-scale convex quadratic programming problem with a linear equality constraint and a simple box constraint, which is generated from the dual problems of the SVMs. By leveraging the primal-dual error bound result, the fast local convergence rate of the augmented Lagrangian method can be guaranteed. Furthermore, by exploiting the second-order sparsity of the problem when using the semismooth Newton method,the algorithm can efficiently solve the aforementioned difficult problems. Finally, numerical comparisons demonstrate that the proposed algorithm outperforms the current state-of-the-art solvers for the large-scale SVMs.

📄 PDF Abstract BibTeX arXiv:1910.01312

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

A dual semismooth Newton based augmented Lagrangian method for large-scale linearly constrained sparse group square-root Lasso problems

2021-11-27 · Chengjing Wang, Peipei Tang

Square-root Lasso problems are proven robust regression problems. Furthermore, square-root regression problems with structured sparsity also plays an important role in statistics and machine learning. In this paper, we f…

regression

A distributed semismooth Newton based augmented Lagrangian method for distributed optimization

2026-02-27 · Qihao Ma, Chengjing Wang, Peipei Tang, Dunbiao Niu 외 arxiv

This paper proposes a novel distributed semismooth Newton based augmented Lagrangian method for solving a class of optimization problems over networks, where the global objective is defined as the sum of locally held cos…

Distributed Optimization

Efficient sparse semismooth Newton methods for the clustered lasso problem

2018-08-22 · Meixia Lin, Yong-Jin Liu, Defeng Sun, Kim-Chuan Toh

We focus on solving the clustered lasso problem, which is a least squares problem with the $\ell_1$-type penalties imposed on both the coefficients and their pairwise differences to learn the group structure of the regre…

An Efficient Semismooth Newton Based Algorithm for Convex Clustering

2018-02-20 · ICML 2018 7 · Yancheng Yuan, Defeng Sun, Kim-Chuan Toh

Clustering may be the most fundamental problem in unsupervised learning which is still active in machine learning research because its importance in many applications. Popular methods like K-means, may suffer from instab…

Clustering

A sparse semismooth Newton based proximal majorization-minimization algorithm for nonconvex square-root-loss regression problems

2019-03-27 · Peipei Tang, Chengjing Wang, Defeng Sun, Kim-Chuan Toh

In this paper, we consider high-dimensional nonconvex square-root-loss regression problems and introduce a proximal majorization-minimization (PMM) algorithm for these problems. Our key idea for making the proposed PMM t…

regression