paper-with-me

홈 › Papers

Equivalence of Multicategory SVM and Simplex Cone SVM: Fast Computations and Statistical Theory

2018-07-01 · ICML 2018 7 · Guillaume Pouliot

The multicategory SVM (MSVM) of Lee et al. (2004) is a natural generalization of the classical, binary support vector machines (SVM). However, its use has been limited by computational difficulties. The simplex-cone SVM (SCSVM) of Mroueh et al. (2012) is a computationally efficient multicategory classifier, but its use has been limited by a seemingly opaque interpretation. We show that MSVM and SCSVM are in fact exactly equivalent, and provide a bijection between their tuning parameters. MSVM may then be entertained as both a natural and computationally efficient multicategory extension of SVM. We further provide a Donsker theorem for finite-dimensional kernel MSVM and partially answer the open question pertaining to the very competitive performance of One-vs-Rest methods against MSVM. Furthermore, we use the derived asymptotic covariance formula to develop an inverse-variance weighted classification rule which improves on the One-vs-Rest approach.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

Open-Ended Question Answering

Methods 이 논문이 사용한 방법론

SVM A Support Vector Machine, or SVM, is a non-parametric supervised learning model. For non-linear classification and regression, they utilise the kernel trick to map inputs…

Similar Papers 제목 키워드 기반

Wasserstein k-means with sparse simplex projection

2020-11-25 · Takumi Fukunaga, Hiroyuki Kasai

This paper presents a proposal of a faster Wasserstein $k$-means algorithm for histogram data by reducing Wasserstein distance computations and exploiting sparse simplex projection. We shrink data samples, centroids, and…

Clustering

On Reject and Refine Options in Multicategory Classification

2017-01-09 · Chong Zhang, Wenbo Wang, Xingye Qiao

In many real applications of statistical learning, a decision made from misclassification can be too costly to afford; in this case, a reject option, which defers the decision until further investigation is conducted, is…

Binary ClassificationClassificationGeneral ClassificationLearning Theory

Causal Linear Topological Filters over a 2-Simplex

2021-10-05 · Georg Essl

Topological filters via sheaves generalize the classical linear translation-invariant filter theory by attaching the filter computation locally to a simplicial topological space. This paper develops topological filters f…

Translation

Multiplicative Updates for Online Convex Optimization over Symmetric Cones

2023-07-06 · Ilayda Canyakmaz, Wayne Lin, Georgios Piliouras, Antonios Varvitsiotis

We study online convex optimization where the possible actions are trace-one elements in a symmetric cone, generalizing the extensively-studied experts setup and its quantum counterpart. Symmetric cones provide a unifyin…

Unimodal Distributions for Ordinal Regression

2023-03-08 · Jaime S. Cardoso, Ricardo Cruz, Tomé Albuquerque

In many real-world prediction tasks, class labels contain information about the relative order between labels that are not captured by commonly used loss functions such as multicategory cross-entropy. Recently, the prefe…

regression