Performance analysis for L\_2 kernel classification
We provide statistical performance guarantees for a recently introduced kernel classifier that optimizes the $L_2$ or integrated squared error (ISE) of a difference of densities. The classifier is similar to a support vector machine (SVM) in that it is the solution of a quadratic program and yields a sparse classifier. Unlike SVMs, however, the $L_2$ kernel classifier does not involve a regularization parameter. We prove a distribution free concentration inequality for a cross-validation based estimate of the ISE, and apply this result to deduce an oracle inequality and consistency of the classifier on the sense of both ISE and probability of error. Our results can also be specialized to give performance guarantees for an existing method of $L_2$ kernel density estimation.
Code (0)
등록된 구현이 없습니다.
Tasks
ClassificationDensity EstimationGeneral ClassificationSimilar Papers 제목 키워드 기반
Efficient multivariate sequence classification
Kernel-based approaches for sequence classification have been successfully applied to a variety of domains, including the text categorization, image classification, speech analysis, biological sequence analysis, time ser…
ClassificationGeneral Classificationimage-classificationImage Classification+4Extrinsic Kernel Ridge Regression Classifier for Planar Kendall Shape Space
Kernel methods have had great success in Statistics and Machine Learning. Despite their growing popularity, however, less effort has been drawn towards developing kernel based classification methods on Riemannian manifol…
ClassificationGeneral ClassificationregressionAccelerated kernel discriminant analysis
In this paper, using a novel matrix factorization and simultaneous reduction to diagonal form approach (or in short simultaneous reduction approach), Accelerated Kernel Discriminant Analysis (AKDA) and Accelerated Kernel…
General ClassificationLearning Schizophrenia Imaging Genetics Data Via Multiple Kernel Canonical Correlation Analysis
Kernel and Multiple Kernel Canonical Correlation Analysis (CCA) are employed to classify schizophrenic and healthy patients based on their SNPs, DNA Methylation and fMRI data. Kernel and Multiple Kernel CCA are popular m…
ClassificationClusteringGeneral ClassificationAny-gram Kernels for Sentence Classification: A Sentiment Analysis Case Study
Any-gram kernels are a flexible and efficient way to employ bag-of-n-gram features when learning from textual data. They are also compatible with the use of word embeddings so that word similarities can be accounted for.…
General ClassificationSentenceSentence ClassificationSentiment Analysis+2