paper-with-me

Papers

Multi-class Probabilistic Bounds for Self-learning

2021-09-29 · Vasilii Feofanov, Emilie Devijver, Massih-Reza Amini

Self-learning is a classical approach for learning with both labeled and unlabeled observations which consists in giving pseudo-labels to unlabeled training instances with a confidence score over a predetermined threshold. At the same time, the pseudo-labeling technique is prone to error and runs the risk of adding noisy labels into unlabeled training data. In this paper, we present a probabilistic framework for analyzing self-learning in the multi-class classification scenario with partially labeled data. First, we derive a transductive bound over the risk of the multi-class majority vote classifier. Based on this result, we propose to automatically choose the threshold for pseudo-labeling that minimizes the transductive bound. Then, we introduce a mislabeling error model to analyze the error of the majority vote classifier in the case of the pseudo-labeled data. We derive a probabilistic C-bound over the majority vote error when an imperfect label is given. Empirical results on different data sets show the effectiveness of our framework compared to several state-of-the-art semi-supervised approaches.

📄 PDF Abstract BibTeX arXiv:2109.14422

Code (0)

등록된 구현이 없습니다.

Tasks

Multi-class ClassificationSelf-Learning

Methods 이 논문이 사용한 방법론

Self-Learning 설명 없음

Similar Papers 제목 키워드 기반

Progress in Self-Certified Neural Networks

2021-11-15 · Maria Perez-Ortiz, Omar Rivasplata, Emilio Parrado-Hernandez, Benjamin Guedj 외

A learning method is self-certified if it uses all available data to simultaneously learn a predictor and certify its quality with a tight statistical certificate that is valid on unseen data. Recent work has shown that …

valid

Sharper convergence bounds of Monte Carlo Rademacher Averages through Self-Bounding functions

2020-10-22 · Leonardo Pellegrina

We derive sharper probabilistic concentration bounds for the Monte Carlo Empirical Rademacher Averages (MCERA), which are proved through recent results on the concentration of self-bounding functions. Our novel bounds ar…

Theoretical Analysis for Expectation-Maximization-Based Multi-Model 3D Registration

2024-05-14 · David Jin, Harry Zhang, Kai Chang

We perform detailed theoretical analysis of an expectation-maximization-based algorithm recently proposed in for solving a variation of the 3D registration problem, named multi-model 3D registration. Despite having shown…

Stochastic Online Convex Optimization. Application to probabilistic time series forecasting

2021-02-01 · Olivier Wintenberger

We introduce a general framework of stochastic online convex optimization to obtain fast-rate stochastic regret bounds. We prove that algorithms such as online newton steps and a scale-free 10 version of Bernstein online…

Probabilistic Time Series ForecastingTime SeriesTime Series AnalysisTime Series Forecasting+1

Learning Probability Measures with respect to Optimal Transport Metrics

2012-12-01 · NeurIPS 2012 12 · Guillermo Canas, Lorenzo Rosasco

We study the problem of estimating, in the sense of optimal transport metrics, a measure which is assumed supported on a manifold embedded in a Hilbert space. By establishing a precise connection between optimal transpor…

Learning TheoryQuantization