paper-with-me

Papers

An Efficient Semismooth Newton Based Algorithm for Convex Clustering

2018-02-20 · ICML 2018 7 · Yancheng Yuan, Defeng Sun, Kim-Chuan Toh

Clustering may be the most fundamental problem in unsupervised learning which is still active in machine learning research because its importance in many applications. Popular methods like K-means, may suffer from instability as they are prone to get stuck in its local minima. Recently, the sum-of-norms (SON) model (also known as clustering path), which is a convex relaxation of hierarchical clustering model, has been proposed in [7] and [5] Although numerical algorithms like ADMM and AMA are proposed to solve convex clustering model [2], it is known to be very challenging to solve large-scale problems. In this paper, we propose a semi-smooth Newton based augmented Lagrangian method for large-scale convex clustering problems. Extensive numerical experiments on both simulated and real data demonstrate that our algorithm is highly efficient and robust for solving large-scale problems. Moreover, the numerical results also show the superior performance and scalability of our algorithm compared to existing first-order methods.

📄 PDF Abstract BibTeX arXiv:1802.07091

Code (0)

등록된 구현이 없습니다.

Tasks

Clustering

Methods 이 논문이 사용한 방법론

ADMM The alternating direction method of multipliers (ADMM) is an algorithm that solves convex optimization problems by breaking them into smaller pieces, each of which are…

Similar Papers 제목 키워드 기반

A Stochastic Semismooth Newton Method for Nonsmooth Nonconvex Optimization

2018-03-09 · Andre Milzarek, Xiantao Xiao, Shicong Cen, Zaiwen Wen 외

In this work, we present a globalized stochastic semismooth Newton method for solving stochastic optimization problems involving smooth nonconvex and nonsmooth convex terms in the objective function. We assume that only …

Binary ClassificationStochastic Optimization

A sparse semismooth Newton based proximal majorization-minimization algorithm for nonconvex square-root-loss regression problems

2019-03-27 · Peipei Tang, Chengjing Wang, Defeng Sun, Kim-Chuan Toh

In this paper, we consider high-dimensional nonconvex square-root-loss regression problems and introduce a proximal majorization-minimization (PMM) algorithm for these problems. Our key idea for making the proposed PMM t…

regression

A Semismooth Newton Stochastic Proximal Point Algorithm with Variance Reduction

2022-04-01 · Andre Milzarek, Fabian Schaipp, Michael Ulbrich

We develop an implementable stochastic proximal point (SPP) method for a class of weakly convex, composite optimization problems. The proposed stochastic proximal point algorithm incorporates a variance reduction mechani…

A sparse semismooth Newton based augmented Lagrangian method for large-scale support vector machines

2019-10-03 · Dunbiao Niu, Chengjing Wang, Peipei Tang, Qingsong Wang 외

Support vector machines (SVMs) are successful modeling and prediction tools with a variety of applications. Previous work has demonstrated the superiority of the SVMs in dealing with the high dimensional, low sample size…

Learning Graph Laplacian with MCP

2020-10-22 · Yangjing Zhang, Kim-Chuan Toh, Defeng Sun

We consider the problem of learning a graph under the Laplacian constraint with a non-convex penalty: minimax concave penalty (MCP). For solving the MCP penalized graphical model, we design an inexact proximal difference…