paper-with-me

Papers

Efficient Output Kernel Learning for Multiple Tasks

2015-11-18 · NeurIPS 2015 12 · Pratik Jawanpuria, Maksim Lapin, Matthias Hein, Bernt Schiele

The paradigm of multi-task learning is that one can achieve better generalization by learning tasks jointly and thus exploiting the similarity between the tasks rather than learning them independently of each other. While previously the relationship between tasks had to be user-defined in the form of an output kernel, recent approaches jointly learn the tasks and the output kernel. As the output kernel is a positive semidefinite matrix, the resulting optimization problems are not scalable in the number of tasks as an eigendecomposition is required in each step. \mbox{Using} the theory of positive semidefinite kernels we show in this paper that for a certain class of regularizers on the output kernel, the constraint of being positive semidefinite can be dropped as it is automatically satisfied for the relaxed problem. This leads to an unconstrained dual problem which can be solved efficiently. Experiments on several multi-task and multi-class data sets illustrate the efficacy of our approach in terms of computational efficiency as well as generalization performance.

📄 PDF Abstract BibTeX arXiv:1511.05706

Code (0)

등록된 구현이 없습니다.

Tasks

Computational EfficiencyMulti-Task Learning

Similar Papers 제목 키워드 기반

Multi-Task Kernel Null-Space for One-Class Classification

2019-05-22 · Shervin Rahimzadeh Arashloo, Josef Kittler

The one-class kernel spectral regression (OC-KSR), the regression-based formulation of the kernel null-space approach has been found to be an effective Fisher criterion-based methodology for one-class classification (OCC…

ClassificationGeneral ClassificationOne-Class Classificationregression

Multi-Output Convolution Spectral Mixture for Gaussian Processes

2018-08-07 · Kai Chen, Twan van Laarhoven, Perry Groot, Jinsong Chen 외

Multi-output Gaussian processes (MOGPs) are an extension of Gaussian Processes (GPs) for predicting multiple output variables (also called channels, tasks) simultaneously. In this paper we use the convolution theorem to …

Gaussian Processes

GP Kernels for Cross-Spectrum Analysis

2015-12-01 · NeurIPS 2015 12 · Kyle R. Ulrich, David E. Carlson, Kafui Dzirasa, Lawrence Carin

Multi-output Gaussian processes provide a convenient framework for multi-task problems. An illustrative and motivating example of a multi-task problem is multi-region electrophysiological time-series data, where experim…

Gaussian ProcessesTime SeriesTime Series Analysis

Kernels for Vector-Valued Functions: a Review

2011-06-30 · Mauricio A. Alvarez, Lorenzo Rosasco, Neil D. Lawrence

Kernel methods are among the most popular techniques in machine learning. From a frequentist/discriminative perspective they play a central role in regularization theory as they provide a natural choice for the hypothese…

Gaussian Processesvalid

On the Identifiability and Interpretability of Gaussian Process Models

2023-09-21 · NeurIPS 2023 11

In this paper, we critically examine the prevalent practice of using additive mixtures of Mat\'ern kernels in single-output Gaussian process (GP) models and explore the properties of multiplicative mixtures of Mat\'ern k…