Provably End-to-end Label-Noise Learning without Anchor Points
In label-noise learning, the transition matrix plays a key role in building statistically consistent classifiers. Existing consistent estimators for the transition matrix have been developed by exploiting anchor points. However, the anchor-point assumption is not always satisfied in real scenarios. In this paper, we propose an end-to-end framework for solving label-noise learning without anchor points, in which we simultaneously optimize two objectives: the cross entropy loss between the noisy label and the predicted probability by the neural network, and the volume of the simplex formed by the columns of the transition matrix. Our proposed framework can identify the transition matrix if the clean class-posterior probabilities are sufficiently scattered. This is by far the mildest assumption under which the transition matrix is provably identifiable and the learned classifier is statistically consistent. Experimental results on benchmark datasets demonstrate the effectiveness and robustness of the proposed method.
Code (1)
Tasks
Learning with noisy labelsSimilar Papers 제목 키워드 기반
Are Anchor Points Really Indispensable in Label-Noise Learning?
In label-noise learning, \textit{noise transition matrix}, denoting the probabilities that clean labels flip into noisy labels, plays a central role in building \textit{statistically consistent classifiers}. Existing the…
Learning with noisy labelsHypothesis Testing for Class-Conditional Label Noise
In this paper we provide machine learning practitioners with tools to answer the question: is there class-conditional noise in my labels? In particular, we present hypothesis tests to check whether a given dataset of ins…
Instance-dependent Label Distribution Estimation for Learning with Label Noise
Noise transition matrix (NTM) estimation is a promising approach for learning with label noise. It can infer clean posterior probabilities, known as Label Distribution (LD), based on noisy ones and reduce the impact of n…
image-classificationImage ClassificationClusterability as an Alternative to Anchor Points When Learning with Noisy Labels
The label noise transition matrix, characterizing the probabilities of a training instance being wrongly annotated, is crucial to designing popular solutions to learning with noisy labels. Existing works heavily rely on …
Image ClassificationImage Classification with Human NoiseImage Classification with Label NoiseLearning with noisy labelsMulti-Label Noise Transition Matrix Estimation with Label Correlations: Theory and Algorithm
Noisy multi-label learning has garnered increasing attention due to the challenges posed by collecting large-scale accurate labels, making noisy labels a more practical alternative. Motivated by noisy multi-class learnin…
Multi-Label Learning