paper-with-me

Papers

Modified Frank-Wolfe Algorithm for Enhanced Sparsity in Support Vector Machine Classifiers

2017-06-19 · Carlos M. Alaíz, Johan A. K. Suykens

This work proposes a new algorithm for training a re-weighted L2 Support Vector Machine (SVM), inspired on the re-weighted Lasso algorithm of Cand\`es et al. and on the equivalence between Lasso and SVM shown recently by Jaggi. In particular, the margin required for each training vector is set independently, defining a new weighted SVM model. These weights are selected to be binary, and they are automatically adapted during the training of the model, resulting in a variation of the Frank-Wolfe optimization algorithm with essentially the same computational complexity as the original algorithm. As shown experimentally, this algorithm is computationally cheaper to apply since it requires less iterations to converge, and it produces models with a sparser representation in terms of support vectors and which are more stable with respect to the selection of the regularization hyper-parameter.

📄 PDF Abstract BibTeX arXiv:1706.05928

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

SVM A Support Vector Machine, or SVM, is a non-parametric supervised learning model. For non-linear classification and regression, they utilise the kernel trick to map inputs…

Similar Papers 제목 키워드 기반

Stochastic In-Face Frank-Wolfe Methods for Non-Convex Optimization and Sparse Neural Network Training

2019-06-09 · Paul Grigas, Alfonso Lobos, Nathan Vermeersch

The Frank-Wolfe method and its extensions are well-suited for delivering solutions with desirable structural properties, such as sparsity or low-rank structure. We introduce a new variant of the Frank-Wolfe method that c…

Primal-Dual Block Frank-Wolfe

2019-06-06 · Qi Lei, Jiacheng Zhuo, Constantine Caramanis, Inderjit S. Dhillon 외

We propose a variant of the Frank-Wolfe algorithm for solving a class of sparse/low-rank optimization problems. Our formulation includes Elastic Net, regularized SVMs and phase retrieval as special cases. The proposed Pr…

General ClassificationMulti-class ClassificationRetrieval

Primal-Dual Block Generalized Frank-Wolfe

2019-12-01 · NeurIPS 2019 12 · Qi Lei, Jiacheng Zhuo, Constantine Caramanis, Inderjit S. Dhillon 외

We propose a generalized variant of Frank-Wolfe algorithm for solving a class of sparse/low-rank optimization problems. Our formulation includes Elastic Net, regularized SVMs and phase retrieval as special cases. The pro…

Multi-class ClassificationRetrieval

Revisiting Frank-Wolfe for Polytopes: Strict Complementarity and Sparsity

2020-05-31 · NeurIPS 2020 12 · Dan Garber

In recent years it was proved that simple modifications of the classical Frank-Wolfe algorithm (aka conditional gradient algorithm) for smooth convex minimization over convex and compact polytopes, converge with linear r…

Interpretable Neural Networks with Frank-Wolfe: Sparse Relevance Maps and Relevance Orderings

2021-10-15 · Jan Macdonald, Mathieu Besançon, Sebastian Pokutta

We study the effects of constrained optimization formulations and Frank-Wolfe algorithms for obtaining interpretable neural network predictions. Reformulating the Rate-Distortion Explanations (RDE) method for relevance a…