Binary Classification from Positive-Confidence Data
Can we learn a binary classifier from only positive data, without any negative data or unlabeled data? We show that if one can equip positive data with confidence (positive-confidence), one can successfully learn a binary classifier, which we name positive-confidence (Pconf) classification. Our work is related to one-class classification which is aimed at "describing" the positive class by clustering-related methods, but one-class classification does not have the ability to tune hyper-parameters and their aim is not on "discriminating" positive and negative classes. For the Pconf classification problem, we provide a simple empirical risk minimization framework that is model-independent and optimization-independent. We theoretically establish the consistency and an estimation error bound, and demonstrate the usefulness of the proposed method for training deep neural networks through experiments.
Code (1)
Tasks
Binary ClassificationClassificationClusteringGeneral ClassificationOne-Class ClassificationSimilar Papers 제목 키워드 기반
Binary Classification from Positive Data with Skewed Confidence
Positive-confidence (Pconf) classification [Ishida et al., 2018] is a promising weakly-supervised learning method which trains a binary classifier only from positive data equipped with confidence. However, in practice, t…
Binary ClassificationClassificationGeneral ClassificationWeakly-supervised LearningNegative Confidence-Aware Weakly Supervised Binary Classification for Effective Review Helpfulness Classification
The incompleteness of positive labels and the presence of many unlabelled instances are common problems in binary classification applications such as in review helpfulness classification. Various studies from the classif…
Binary ClassificationClassificationGeneral ClassificationClassification from Positive and Biased Negative Data with Skewed Labeled Posterior Probability
The binary classification problem has a situation where only biased data are observed in one of the classes. In this paper, we propose a new method to approach the positive and biased negative (PbN) classification proble…
Binary ClassificationClassificationWeakly-supervised LearningBinary Classification with Confidence Difference
Recently, learning with soft labels has been shown to achieve better performance than learning with hard labels in terms of model generalization, calibration, and robustness. However, collecting pointwise labeling confid…
Binary ClassificationClassificationRecommendation SystemsDon't Just Blame Over-parametrization for Over-confidence: Theoretical Analysis of Calibration in Binary Classification
Modern machine learning models with high accuracy are often miscalibrated -- the predicted top probability does not reflect the actual accuracy, and tends to be over-confident. It is commonly believed that such over-conf…
Binary Classification