paper-with-me

Papers

Infinite-Task Learning with RKHSs

2018-05-22 · Romain Brault, Alex Lambert, Zoltán Szabó, Maxime Sangnier, Florence d'Alché-Buc

Machine learning has witnessed tremendous success in solving tasks depending on a single hyperparameter. When considering simultaneously a finite number of tasks, multi-task learning enables one to account for the similarities of the tasks via appropriate regularizers. A step further consists of learning a continuum of tasks for various loss functions. A promising approach, called \emph{Parametric Task Learning}, has paved the way in the continuum setting for affine models and piecewise-linear loss functions. In this work, we introduce a novel approach called \emph{Infinite Task Learning} whose goal is to learn a function whose output is a function over the hyperparameter space. We leverage tools from operator-valued kernels and the associated vector-valued RKHSs that provide an explicit control over the role of the hyperparameters, and also allows us to consider new type of constraints. We provide generalization guarantees to the suggested scheme and illustrate its efficiency in cost-sensitive classification, quantile regression and density level set estimation.

📄 PDF Abstract BibTeX arXiv:1805.08809

Code (0)

등록된 구현이 없습니다.

Tasks

Multi-Task Learningquantile regression

Similar Papers 제목 키워드 기반

Unbiased Stochastic Optimization for Gaussian Processes on Finite Dimensional RKHS

2025-08-28 · Neta Shoham, Haim Avron arxiv

Current methods for stochastic hyperparameter learning in Gaussian Processes (GPs) rely on approximations, such as computing biased stochastic gradients or using inducing points in stochastic variational inference. Howev…

Stochastic OptimizationGaussian Processes

Sobolev Norm Learning Rates for Conditional Mean Embeddings

2021-05-16 · Prem Talwai, Ali Shameli, David Simchi-Levi

We develop novel learning rates for conditional mean embeddings by applying the theory of interpolation for reproducing kernel Hilbert spaces (RKHS). We derive explicit, adaptive convergence rates for the sample estimato…

Handling Hard Affine SDP Shape Constraints in RKHSs

2021-01-05 · Pierre-Cyril Aubin-Frankowski, Zoltan Szabo

Shape constraints, such as non-negativity, monotonicity, convexity or supermodularity, play a key role in various applications of machine learning and statistics. However, incorporating this side information into predict…

Econometrics

Neural Hilbert Ladders: Multi-Layer Neural Networks in Function Space

2023-07-03 · Zhengdao Chen

To characterize the function space explored by neural networks (NNs) is an important aspect of learning theory. In this work, noticing that a multi-layer NN generates implicitly a hierarchy of reproducing kernel Hilbert …

Learning Theory

Nonparametric Control Koopman Operators

2024-05-12 · Petar Bevanda, Bas Driessen, Lucian Cristian Iacob, Stefan Sosnowski 외

This paper presents a novel Koopman (composition) operator representation framework for control systems in reproducing kernel Hilbert spaces (RKHSs) that is free of explicit dictionary or input parametrizations. By estab…

Learning TheoryModel Predictive ControlOperator learning