A Simple Algorithm for Semi-supervised Learning with Improved Generalization Error Bound
In this work, we develop a simple algorithm for semi-supervised regression. The key idea is to use the top eigenfunctions of integral operator derived from both labeled and unlabeled examples as the basis functions and learn the prediction function by a simple linear regression. We show that under appropriate assumptions about the integral operator, this approach is able to achieve an improved regression error bound better than existing bounds of supervised learning. We also verify the effectiveness of the proposed algorithm by an empirical study.
Code (0)
등록된 구현이 없습니다.
Tasks
regressionSimilar Papers 제목 키워드 기반
Improved Generalization of Heading Direction Estimation for Aerial Filming Using Semi-supervised Regression
In the task of Autonomous aerial filming of a moving actor (e.g. a person or a vehicle), it is crucial to have a good heading direction estimation for the actor from the visual input. However, the models obtained in othe…
regressionSemi-Supervised Noise Adaptation: Transferring Knowledge from Noise Domain
Transfer learning aims to facilitate the learning of a target domain by transferring knowledge from a source domain. The source domain typically contains semantically meaningful samples (*e.g.*, images) to facilitate eff…
Transfer LearningSemi-Supervised Learning by Disentangling and Self-Ensembling Over Stochastic Latent Space
The success of deep learning in medical imaging is mostly achieved at the cost of a large labeled data set. Semi-supervised learning (SSL) provides a promising solution by leveraging the structure of unlabeled data to im…
Data AugmentationMulti-Label ClassificationMUlTI-LABEL-ClASSIFICATIONRepresentation LearningInformation-Theoretic Generalization Bounds for Iterative Semi-Supervised Learning
We consider iterative semi-supervised learning (SSL) algorithms that iteratively generate pseudo-labels for a large amount unlabelled data to progressively refine the model parameters. In particular, we seek to understa…
Generalization BoundsRevisiting Deep Semi-supervised Learning: An Empirical Distribution Alignment Framework and Its Generalization Bound
In this work, we revisit the semi-supervised learning (SSL) problem from a new perspective of explicitly reducing empirical distribution mismatch between labeled and unlabeled samples. Benefited from this new perspective…
Data AugmentationDomain Adaptation