Support Vector Machine Classification with Indefinite Kernels
In this paper, we propose a method for support vector machine classification using indefinite kernels. Instead of directly minimizing or stabilizing a nonconvex loss function, our method simultaneously finds the support vectors and a proxy kernel matrix used in computing the loss. This can be interpreted as a robust classification problem where the indefinite kernel matrix is treated as a noisy observation of the true positive semidefinite kernel. Our formulation keeps the problem convex and relatively large problems can be solved efficiently using the analytic center cutting plane method. We compare the performance of our technique with other methods on several data sets.
Code (0)
등록된 구현이 없습니다.
Tasks
ClassificationGeneral ClassificationRobust classificationSimilar Papers 제목 키워드 기반
Towards Unbiased Random Features with Lower Variance For Stationary Indefinite Kernels
Random Fourier Features (RFF) demonstrate wellappreciated performance in kernel approximation for largescale situations but restrict kernels to be stationary and positive definite. And for non-stationary kernels, the cor…
regressionProbabilistic classifiers with low rank indefinite kernels
Indefinite similarity measures can be frequently found in bio-informatics by means of alignment scores, but are also common in other fields like shape measures in image retrieval. Lacking an underlying vector space, the …
Image RetrievalRetrievalLarge Scale, Large Margin Classification using Indefinite Similarity Measures
Despite the success of the popular kernelized support vector machines, they have two major limitations: they are restricted to Positive Semi-Definite (PSD) kernels, and their training complexity scales at least quadratic…
ClassificationGeneral ClassificationAn Empirical Approach For Probing the Definiteness of Kernels
Models like support vector machines or Gaussian process regression often require positive semi-definite kernels. These kernels may be based on distance functions. While definiteness is proven for common distances and ker…
Scalable Learning in Reproducing Kernel Krein Spaces
We provide the first mathematically complete derivation of the Nystr\"om method for low-rank approximation of indefinite kernels and propose an efficient method for finding an approximate eigendecomposition of such kerne…
Time SeriesTime Series Analysis