Partial-Label Learning with a Reject Option
In real-world applications, one often encounters ambiguously labeled data, where different annotators assign conflicting class labels. Partial-label learning allows training classifiers in this weakly supervised setting, where state-of-the-art methods already show good predictive performance. However, even the best algorithms give incorrect predictions, which can have severe consequences when they impact actions or decisions. We propose a novel risk-consistent nearest-neighbor-based partial-label learning algorithm with a reject option, that is, the algorithm can reject unsure predictions. Extensive experiments on artificial and real-world datasets show that our method provides the best trade-off between the number and accuracy of non-rejected predictions when compared to our competitors, which use confidence thresholds for rejecting unsure predictions. When evaluated without the reject option, our nearest-neighbor-based approach also achieves competitive prediction performance.
Code (1)
Tasks
Autonomous DrivingPartial Label LearningSimilar Papers 제목 키워드 기반
Regression with reject option and application to kNN
We investigate the problem of regression where one is allowed to abstain from predicting. We refer to this framework as regression with reject option as an extension of classification with reject option. In this context,…
regressionOnline Active Learning of Reject Option Classifiers
Active learning is an important technique to reduce the number of labeled examples in supervised learning. Active learning for binary classification has been well addressed in machine learning. However, active learning o…
Active LearningBinary ClassificationGeneral ClassificationCategory-Adaptive Label Discovery and Noise Rejection for Multi-label Image Recognition with Partial Positive Labels
As a promising solution of reducing annotation cost, training multi-label models with partial positive labels (MLR-PPL), in which merely few positive labels are known while other are missing, attracts increasing attentio…
Multi-Label Image RecognitionSemantic SimilaritySemantic Textual SimilarityTake It or Leave It: Intent-Controlled Partial Optimal Transport
While optimal transport (OT) enforces a rigid constraint by requiring two measures to be matched exactly, partial optimal transport relaxes this requirement by allowing mass to remain unmatched through a global budget, s…
Partial Domain AdaptationOn Reject and Refine Options in Multicategory Classification
In many real applications of statistical learning, a decision made from misclassification can be too costly to afford; in this case, a reject option, which defers the decision until further investigation is conducted, is…
Binary ClassificationClassificationGeneral ClassificationLearning Theory