paper-with-me

Papers

A Proximal Approach for Sparse Multiclass SVM

2015-01-15 · G. Chierchia, Nelly Pustelnik, Jean-Christophe Pesquet, B. Pesquet-Popescu

Sparsity-inducing penalties are useful tools to design multiclass support vector machines (SVMs). In this paper, we propose a convex optimization approach for efficiently and exactly solving the multiclass SVM learning problem involving a sparse regularization and the multiclass hinge loss formulated by Crammer and Singer. We provide two algorithms: the first one dealing with the hinge loss as a penalty term, and the other one addressing the case when the hinge loss is enforced through a constraint. The related convex optimization problems can be efficiently solved thanks to the flexibility offered by recent primal-dual proximal algorithms and epigraphical splitting techniques. Experiments carried out on several datasets demonstrate the interest of considering the exact expression of the hinge loss rather than a smooth approximation. The efficiency of the proposed algorithms w.r.t. several state-of-the-art methods is also assessed through comparisons of execution times.

📄 PDF Abstract BibTeX arXiv:1501.03669

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

SVM A Support Vector Machine, or SVM, is a non-parametric supervised learning model. For non-linear classification and regression, they utilise the kernel trick to map inputs…

Similar Papers 제목 키워드 기반

Accelerated Proximal Stochastic Dual Coordinate Ascent for Regularized Loss Minimization

2013-09-10 · Shai Shalev-Shwartz, Tong Zhang

We introduce a proximal version of the stochastic dual coordinate ascent method and show how to accelerate the method using an inner-outer iteration procedure. We analyze the runtime of the framework and obtain rates tha…

BIG-bench Machine Learningregression

Generalization Error Bounds for Multiclass Sparse Linear Classifiers

2022-04-13 · Tomer Levy, Felix Abramovich

We consider high-dimensional multiclass classification by sparse multinomial logistic regression. Unlike binary classification, in the multiclass setup one can think about an entire spectrum of possible notions of sparsi…

Binary Classificationfeature selectionregression

MISS: Multiclass Interpretable Scoring Systems

2024-01-10 · Michal K. Grzeszczyk, Tomasz Trzciński, Arkadiusz Sitek

In this work, we present a novel, machine-learning approach for constructing Multiclass Interpretable Scoring Systems (MISS) - a fully data-driven methodology for generating single, sparse, and user-friendly scoring syst…

Binary ClassificationClassificationDimensionality Reduction

Multiclass Local Calibration with the Jensen-Shannon Distance

2025-10-30 · Cesare Barbera, Lorenzo Perini, Giovanni De Toni, Andrea Passerini 외 arxiv

Developing trustworthy Machine Learning (ML) models requires their predicted probabilities to be well-calibrated, meaning they should reflect true-class frequencies. Among calibration notions in multiclass classification…

Novel sparse PCA method via Runge Kutta numerical method(s) for face recognition

2025-03-30 · Loc Hoang Tran, Luong Anh Tuan Nguyen

Face recognition is a crucial topic in data science and biometric security, with applications spanning military, finance, and retail industries. This paper explores the implementation of sparse Principal Component Analys…

Face Recognition