paper-with-me

홈 › Papers

Universal Kernels on Non-Standard Input Spaces

2010-12-01 · NeurIPS 2010 12 · Andreas Christmann, Ingo Steinwart

During the last years support vector machines (SVMs) have been successfully applied even in situations where the input space $X$ is not necessarily a subset of $R^d$. Examples include SVMs using probability measures to analyse e.g. histograms or coloured images, SVMs for text classification and web mining, and SVMs for applications from computational biology using, e.g., kernels for trees and graphs. Moreover, SVMs are known to be consistent to the Bayes risk, if either the input space is a complete separable metric space and the reproducing kernel Hilbert space (RKHS) $H\subset L_p(P_X)$ is dense, or if the SVM is based on a universal kernel $k$. So far, however, there are no RKHSs of practical interest known that satisfy these assumptions on $\cH$ or $k$ if $X \not\subset R^d$. We close this gap by providing a general technique based on Taylor-type kernels to explicitly construct universal kernels on compact metric spaces which are not subset of $R^d$. We apply this technique for the following special cases: universal kernels on the set of probability measures, universal kernels based on Fourier transforms, and universal kernels for signal processing.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

text-classificationText Classification

Methods 이 논문이 사용한 방법론

SVM A Support Vector Machine, or SVM, is a non-parametric supervised learning model. For non-linear classification and regression, they utilise the kernel trick to map inputs…

Similar Papers 제목 키워드 기반

Universal kernels via harmonic analysis on Riemannian symmetric spaces

2025-06-24 · Franziskus Steinert, Salem Said, Cyrus Mostajeran

The universality properties of kernels characterize the class of functions that can be approximated in the associated reproducing kernel Hilbert space and are of fundamental importance in the theoretical underpinning of …

Global universal approximation of functional input maps on weighted spaces

2023-06-05 · Christa Cuchiero, Philipp Schmocker, Josef Teichmann

We introduce so-called functional input neural networks defined on a possibly infinite dimensional weighted space with values also in a possibly infinite dimensional output space. To this end, we use an additive family t…

Gaussian ProcessesregressionUncertainty Quantification

Expanding the Family of Grassmannian Kernels: An Embedding Perspective

2014-07-04 · Mehrtash T. Harandi, Mathieu Salzmann, Sadeep Jayasumana, Richard Hartley 외

Modeling videos and image-sets as linear subspaces has proven beneficial for many visual recognition tasks. However, it also incurs challenges arising from the fact that linear subspaces do not obey Euclidean geometry, b…

Clustering

Transformers are Deep Infinite-Dimensional Non-Mercer Binary Kernel Machines

2021-06-02 · Matthew A. Wright, Joseph E. Gonzalez

Despite their ubiquity in core AI fields like natural language processing, the mechanics of deep attention-based neural networks like the Transformer model are not fully understood. In this article, we present a new pers…

Deep Attention

Characteristic kernels on Hilbert spaces, Banach spaces, and on sets of measures

2022-06-15 · Johanna Ziegel, David Ginsbourger, Lutz Dümbgen

We present new classes of positive definite kernels on non-standard spaces that are integrally strictly positive definite or characteristic. In particular, we discuss radial kernels on separable Hilbert spaces, and intro…