paper-with-me

홈 › Papers

Provably Consistent Partial-Label Learning

2020-07-17 · NeurIPS 2020 12 · Lei Feng, Jiaqi Lv, Bo Han, Miao Xu, Gang Niu, Xin Geng, Bo An, Masashi Sugiyama

Partial-label learning (PLL) is a multi-class classification problem, where each training example is associated with a set of candidate labels. Even though many practical PLL methods have been proposed in the last two decades, there lacks a theoretical understanding of the consistency of those methods-none of the PLL methods hitherto possesses a generation process of candidate label sets, and then it is still unclear why such a method works on a specific dataset and when it may fail given a different dataset. In this paper, we propose the first generation model of candidate label sets, and develop two novel PLL methods that are guaranteed to be provably consistent, i.e., one is risk-consistent and the other is classifier-consistent. Our methods are advantageous, since they are compatible with any deep network or stochastic optimizer. Furthermore, thanks to the generation model, we would be able to answer the two questions above by testing if the generation model matches given candidate label sets. Experiments on benchmark and real-world datasets validate the effectiveness of the proposed generation model and two PLL methods.

📄 PDF Abstract BibTeX arXiv:2007.08929

Code (0)

등록된 구현이 없습니다.

Tasks

Multi-class ClassificationPartial Label Learning

Similar Papers 제목 키워드 기반

Adversary-Aware Partial label learning with Label distillation

2023-04-02 · Cheng Chen, Yueming Lyu, Ivor W. Tsang

To ensure that the data collected from human subjects is entrusted with a secret, rival labels are introduced to conceal the information provided by the participants on purpose. The corresponding learning task can be for…

Partial Label Learning

Provably End-to-end Label-Noise Learning without Anchor Points

2021-02-04 · Xuefeng Li, Tongliang Liu, Bo Han, Gang Niu 외

In label-noise learning, the transition matrix plays a key role in building statistically consistent classifiers. Existing consistent estimators for the transition matrix have been developed by exploiting anchor points. …

Learning with noisy labels

Learning Linear Dynamical Systems with Semi-Parametric Least Squares

2019-02-02 · Max Simchowitz, Ross Boczar, Benjamin Recht

We analyze a simple prefiltered variation of the least squares estimator for the problem of estimation with biased, semi-parametric noise, an error model studied more broadly in causal statistics and active learning. We …

Active Learning

A Consistent Diffusion-Based Algorithm for Semi-Supervised Graph Learning

2023-11-13 · Thomas Bonald, Nathan de Lara

The task of semi-supervised classification aims at assigning labels to all nodes of a graph based on the labels known for a few nodes, called the seeds. One of the most popular algorithms relies on the principle of heat …

Graph Learning

Active Labeling: Streaming Stochastic Gradients

2022-05-26 · Vivien Cabannes, Francis Bach, Vianney Perchet, Alessandro Rudi

The workhorse of machine learning is stochastic gradient descent. To access stochastic gradients, it is common to consider iteratively input/output pairs of a training dataset. Interestingly, it appears that one does not…

Active Learningregression