Error-Bounded Correction of Noisy Labels
To collect large scale annotated data, it is inevitable to introduce label noise, i.e., incorrect class labels. To be robust against label noise, many successful methods rely on the noisy classifiers (i.e., models trained on the noisy training data) to determine whether a label is trustworthy. However, it remains unknown why this heuristic works well in practice. In this paper, we provide the first theoretical explanation for these methods. We prove that the prediction of a noisy classifier can indeed be a good indicator of whether the label of a training data is clean. Based on the theoretical result, we propose a novel algorithm that corrects the labels based on the noisy classifier prediction. The corrected labels are consistent with the true Bayesian optimal classifier with high probability. We incorporate our label correction algorithm into the training of deep neural networks and train models that achieve superior testing performance on multiple public datasets.
Code (3)
Tasks
Image ClassificationSimilar Papers 제목 키워드 기반
Robust Self-Training with Closed-loop Label Correction for Learning from Noisy Labels
Training deep neural networks with noisy labels remains a significant challenge, often leading to degraded performance. Existing methods for handling label noise typically rely on either transition matrix, noise detectio…
Bilevel OptimizationLearning to Segment from Noisy Annotations: A Spatial Correction Approach
Noisy labels can significantly affect the performance of deep neural networks (DNNs). In medical image segmentation tasks, annotations are error-prone due to the high demand in annotation time and in the annotators' expe…
Image SegmentationMedical Image SegmentationSegmentationSemantic SegmentationLearning to Clean: Reinforcement Learning for Noisy Label Correction
The challenge of learning with noisy labels is significant in machine learning, as it can severely degrade the performance of prediction models if not addressed properly. This paper introduces a novel framework that conc…
Learning with noisy labelsReinforcement LearningImproving Grammatical Error Correction via Contextual Data Augmentation
Nowadays, data augmentation through synthetic data has been widely used in the field of Grammatical Error Correction (GEC) to alleviate the problem of data scarcity. However, these synthetic data are mainly used in the p…
Data AugmentationGrammatical Error CorrectionMeta Label Correction for Noisy Label Learning
Leveraging weak or noisy supervision for building effective machine learning models has long been an important research problem. Its importance has further increased recently due to the growing need for large-scale datas…
Image ClassificationLearning with noisy labelsMeta-Learningtext-classification+1