paper-with-me

Papers

Semi-supervised Vector-valued Learning: Improved Bounds and Algorithms

2019-09-11 · Jian Li, Yong liu, Weiping Wang

Vector-valued learning, where the output space admits a vector-valued structure, is an important problem that covers a broad family of important domains, e.g. multi-task learning and transfer learning. Using local Rademacher complexity and unlabeled data, we derive novel semi-supervised excess risk bounds for general vector-valued learning from both kernel perspective and linear perspective. The derived bounds are much sharper than existing ones and the convergence rates are improved from the square root of labeled sample size to the square root of total sample size or directly dependent on labeled sample size. Motivated by our theoretical analysis, we propose a general semi-supervised algorithm for efficiently learning vector-valued functions, incorporating both local Rademacher complexity and Laplacian regularization. Extensive experimental results illustrate the proposed algorithm significantly outperforms the compared methods, which coincides with our theoretical findings.

📄 PDF Abstract BibTeX arXiv:1909.04883

Code (1)

superlj666/Learning-Vector-valued-Functions-with-Local-Rademacher-Complexity

Tasks

Multi-class ClassificationMulti-Label LearningMulti-Task LearningTransfer Learning

Similar Papers 제목 키워드 기반

Bounds for Vector-Valued Function Estimation

2016-06-05 · Andreas Maurer, Massimiliano Pontil

We present a framework to derive risk bounds for vector-valued learning with a broad class of feature maps and loss functions. Multi-task learning and one-vs-all multi-category learning are treated as examples. We discus…

Multi-Task Learning

Vector-Valued Graph Trend Filtering with Non-Convex Penalties

2019-05-29 · Rohan Varma, Harlin Lee, Jelena Kovačević, Yuejie Chi

This work studies the denoising of piecewise smooth graph signals that exhibit inhomogeneous levels of smoothness over a graph, where the value at each node can be vector-valued. We extend the graph trend filtering frame…

DenoisingEvent DetectionGeneral Classification

Fine-grained Generalization Analysis of Vector-valued Learning

2021-04-29 · Liang Wu, Antoine Ledent, Yunwen Lei, Marius Kloft

Many fundamental machine learning tasks can be formulated as a problem of learning with vector-valued functions, where we learn multiple scalar-valued functions together. Although there is some generalization analysis on…

Extreme Multi-Label ClassificationGeneral ClassificationGeneralization BoundsMulti-class Classification+2

Multi-Task Classification Hypothesis Space with Improved Generalization Bounds

2013-12-09 · Cong Li, Michael Georgiopoulos, Georgios C. Anagnostopoulos

This paper presents a RKHS, in general, of vector-valued functions intended to be used as hypothesis space for multi-task classification. It extends similar hypothesis spaces that have previously considered in the litera…

ClassificationGeneral ClassificationGeneralization BoundsMulti-Task Learning

Vector-valued self-normalized concentration inequalities beyond sub-Gaussianity

2025-11-05 · Diego Martinez-Taboada, Tomas Gonzalez, Aaditya Ramdas arxiv

The study of self-normalized processes plays a crucial role in a wide range of applications, from sequential decision-making to econometrics. While the behavior of self-normalized concentration has been widely investigat…