Semi-supervised Vector-valued Learning: Improved Bounds and Algorithms
Vector-valued learning, where the output space admits a vector-valued structure, is an important problem that covers a broad family of important domains, e.g. multi-task learning and transfer learning. Using local Rademacher complexity and unlabeled data, we derive novel semi-supervised excess risk bounds for general vector-valued learning from both kernel perspective and linear perspective. The derived bounds are much sharper than existing ones and the convergence rates are improved from the square root of labeled sample size to the square root of total sample size or directly dependent on labeled sample size. Motivated by our theoretical analysis, we propose a general semi-supervised algorithm for efficiently learning vector-valued functions, incorporating both local Rademacher complexity and Laplacian regularization. Extensive experimental results illustrate the proposed algorithm significantly outperforms the compared methods, which coincides with our theoretical findings.
Code (1)
Tasks
Multi-class ClassificationMulti-Label LearningMulti-Task LearningTransfer LearningSimilar Papers 제목 키워드 기반
Bounds for Vector-Valued Function Estimation
We present a framework to derive risk bounds for vector-valued learning with a broad class of feature maps and loss functions. Multi-task learning and one-vs-all multi-category learning are treated as examples. We discus…
Multi-Task LearningVector-Valued Graph Trend Filtering with Non-Convex Penalties
This work studies the denoising of piecewise smooth graph signals that exhibit inhomogeneous levels of smoothness over a graph, where the value at each node can be vector-valued. We extend the graph trend filtering frame…
DenoisingEvent DetectionGeneral ClassificationFine-grained Generalization Analysis of Vector-valued Learning
Many fundamental machine learning tasks can be formulated as a problem of learning with vector-valued functions, where we learn multiple scalar-valued functions together. Although there is some generalization analysis on…
Extreme Multi-Label ClassificationGeneral ClassificationGeneralization BoundsMulti-class Classification+2Multi-Task Classification Hypothesis Space with Improved Generalization Bounds
This paper presents a RKHS, in general, of vector-valued functions intended to be used as hypothesis space for multi-task classification. It extends similar hypothesis spaces that have previously considered in the litera…
ClassificationGeneral ClassificationGeneralization BoundsMulti-Task LearningVector-valued self-normalized concentration inequalities beyond sub-Gaussianity
The study of self-normalized processes plays a crucial role in a wide range of applications, from sequential decision-making to econometrics. While the behavior of self-normalized concentration has been widely investigat…