paper-with-me

홈 › Papers

Alternating direction method of multipliers for regularized multiclass support vector machines

2015-11-30 · Yangyang Xu, Ioannis Akrotirianakis, Amit Chakraborty

The support vector machine (SVM) was originally designed for binary classifications. A lot of effort has been put to generalize the binary SVM to multiclass SVM (MSVM) which are more complex problems. Initially, MSVMs were solved by considering their dual formulations which are quadratic programs and can be solved by standard second-order methods. However, the duals of MSVMs with regularizers are usually more difficult to formulate and computationally very expensive to solve. This paper focuses on several regularized MSVMs and extends the alternating direction method of multiplier (ADMM) to these MSVMs. Using a splitting technique, all considered MSVMs are written as two-block convex programs, for which the ADMM has global convergence guarantees. Numerical experiments on synthetic and real data demonstrate the high efficiency and accuracy of our algorithms.

📄 PDF Abstract BibTeX arXiv:1511.09153

Code (0)

등록된 구현이 없습니다.

Tasks

Second-order methods

Methods 이 논문이 사용한 방법론

SVM A Support Vector Machine, or SVM, is a non-parametric supervised learning model. For non-linear classification and regression, they utilise the kernel trick to map inputs…
ADMM The alternating direction method of multipliers (ADMM) is an algorithm that solves convex optimization problems by breaking them into smaller pieces, each of which are…

Similar Papers 제목 키워드 기반

An Empirical Study of ADMM for Nonconvex Problems

2016-12-10 · Zheng Xu, Soham De, Mario Figueiredo, Christoph Studer 외

The alternating direction method of multipliers (ADMM) is a common optimization tool for solving constrained and non-differentiable problems. We provide an empirical study of the practical performance of ADMM on several …

DenoisingImage DenoisingregressionRetrieval

Alternating minimization algorithms for graph regularized tensor completion

2020-08-28 · Yu Guan, Shuyu Dong, Bin Gao, P. -A. Absil 외

We consider a Canonical Polyadic (CP) decomposition approach to low-rank tensor completion (LRTC) by incorporating external pairwise similarity relations through graph Laplacian regularization on the CP factor matrices. …

Iteratively Linearized Reweighted Alternating Direction Method of Multipliers for a Class of Nonconvex Problems

2017-09-01 · Tao Sun, Hao Jiang, Lizhi Cheng, Wei Zhu

In this paper, we consider solving a class of nonconvex and nonsmooth problems frequently appearing in signal processing and machine learning research. The traditional alternating direction method of multipliers encounte…

Constrained and Regularized Quantitative Ultrasound Parameter Estimation using ADMM

2025-01-07 · Ali K. Z. Tehrani, Hassan Rivaz, Ivan M. Rosado-Mendez

Regularized estimation of quantitative ultrasound (QUS) parameters, such as attenuation and backscatter coefficients, has gained research interest. Recently, the alternating direction method of multipliers (ADMM) has bee…

parameter estimation

Hierarchical Non-Stationary Temporal Gaussian Processes With $L^1$-Regularization

2021-05-20 · Zheng Zhao, Rui Gao, Simo Särkkä

This paper is concerned with regularized extensions of hierarchical non-stationary temporal Gaussian processes (NSGPs) in which the parameters (e.g., length-scale) are modeled as GPs. In particular, we consider two commo…

Gaussian Processesregression