paper-with-me

Papers

Deep banach space kernels

2021-09-29 · Mrityunjay Bhardwaj

The recent success of deep learning has encouraged many researchers to explore the deep/concatenated variants of classical kernel methods. Some of which includes MLMKL, DGP and DKL. Although, These methods have proven to be quite useful in various real-world settings. They still suffer from the limitations of only utilizing kernels from Hilbert spaces. In this paper, we address these shortcomings by introducing a new class of concatenated kernel learning methods that use the kernels from the reproducing kernel Banach spaces(RKBSs). These spaces turned out to be one of the most general spaces where a reproducing Kernel exists. We propose a framework of construction for these Deep RKBS models and then provide a representer theorem for regularized learning problems. We also describe the relationship with its deep RKHS variant as well as standard Deep Gaussian Processes. In the end, we construct and implement a two-layer deep RKBS model and demonstrate it on a range of machine learning tasks.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

Gaussian Processes

Methods 이 논문이 사용한 방법론

DKL 설명 없음

Similar Papers 제목 키워드 기반

Characteristic kernels on Hilbert spaces, Banach spaces, and on sets of measures

2022-06-15 · Johanna Ziegel, David Ginsbourger, Lutz Dümbgen

We present new classes of positive definite kernels on non-standard spaces that are integrally strictly positive definite or characteristic. In particular, we discuss radial kernels on separable Hilbert spaces, and intro…

Generalized support vector regression: duality and tensor-kernel representation

2016-03-18 · Saverio Salzo, Johan A. K. Suykens

In this paper we study the variational problem associated to support vector regression in Banach function spaces. Using the Fenchel-Rockafellar duality theory, we give explicit formulation of the dual problem as well as …

regression

Solving Support Vector Machines in Reproducing Kernel Banach Spaces with Positive Definite Functions

2012-09-06 · Gregory E. Fasshauer, Fred J. Hickernell, Qi Ye

In this paper we solve support vector machines in reproducing kernel Banach spaces with reproducing kernels defined on nonsymmetric domains instead of the traditional methods in reproducing kernel Hilbert spaces. Using t…

Transformers are Deep Infinite-Dimensional Non-Mercer Binary Kernel Machines

2021-06-02 · Matthew A. Wright, Joseph E. Gonzalez

Despite their ubiquity in core AI fields like natural language processing, the mechanics of deep attention-based neural networks like the Transformer model are not fully understood. In this article, we present a new pers…

Deep Attention

Native Banach spaces for splines and variational inverse problems

2019-04-24 · Michael Unser, Julien Fageot

We propose a systematic construction of native Banach spaces for general spline-admissible operators ${\rm L}$. In short, the native space for ${\rm L}$ and the (dual) norm $\|\cdot\|_{\mathcal{X}'}$ is the largest space…