paper-with-me

Papers

Approximate Representer Theorems in Non-reflexive Banach Spaces

2019-11-01 · Kevin Schlegel

The representer theorem is one of the most important mathematical foundations for regularised learning and kernel methods. Classical formulations of the theorem state sufficient conditions under which a regularisation problem on a Hilbert space admits a solution in the subspace spanned by the representers of the data points. This turns the problem into an equivalent optimisation problem in a finite dimensional space, making it computationally tractable. Moreover, Banach space methods for learning have been receiving more and more attention. Considering the representer theorem in Banach spaces is hence of increasing importance. Recently the question of the necessary condition for a representer theorem to hold in Hilbert spaces and certain Banach spaces has been considered. It has been shown that a classical representer theorem cannot exist in general in non-reflexive Banach spaces. In this paper we propose a notion of approximate solutions and approximate representer theorem to overcome this problem. We show that for these notions we can indeed extend the previous results to obtain a unified theory for the existence of representer theorems in any general Banach spaces, in particular including $l_1$-type spaces. We give a precise characterisation when a regulariser admits a classical representer theorem and when only an approximate representer theorem is possible.

📄 PDF Abstract BibTeX arXiv:1911.00433

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

When is there a Representer Theorem? Reflexive Banach spaces

2018-09-26 · Kevin Schlegel

We consider a general regularised interpolation problem for learning a parameter vector from data. The well known representer theorem says that under certain conditions on the regulariser there exists a solution in the l…

Learning Theory

On Reproducing Kernel Banach Spaces: Generic Definitions and Unified Framework of Constructions

2019-01-04 · Rongrong Lin, Haizhang Zhang, Jun Zhang

Recently, there has been emerging interest in constructing reproducing kernel Banach spaces (RKBS) for applied and theoretical purposes such as machine learning, sampling reconstruction, sparse approximation and function…

BIG-bench Machine Learning

Analysis of Regularized Learning in Banach Spaces for Linear-functional Data

2021-09-07 · Qi Ye

This article delves into the study of the theory of regularized learning in Banach spaces for linear-functional data. It encompasses discussions on representer theorems, pseudo-approximation theorems, and convergence the…

Featured Reproducing Kernel Banach Spaces for Learning and Neural Networks

2026-02-06 · Isabel de la Higuera, Francisco Herrera, M. Victoria Velasco arxiv

Reproducing kernel Hilbert spaces provide a foundational framework for kernel-based learning, where regularization and interpolation problems admit finite-dimensional solutions through classical representer theorems. Man…

Neural reproducing kernel Banach spaces and representer theorems for deep networks

2024-03-13 · Francesca Bartolucci, Ernesto de Vito, Lorenzo Rosasco, Stefano Vigogna

Studying the function spaces defined by neural networks helps to understand the corresponding learning models and their inductive bias. While in some limits neural networks correspond to function spaces that are reproduc…

Inductive Bias