Information-Theoretic Representation Learning for Positive-Unlabeled Classification
Recent advances in weakly supervised classification allow us to train a classifier only from positive and unlabeled (PU) data. However, existing PU classification methods typically require an accurate estimate of the class-prior probability, which is a critical bottleneck particularly for high-dimensional data. This problem has been commonly addressed by applying principal component analysis in advance, but such unsupervised dimension reduction can collapse underlying class structure. In this paper, we propose a novel representation learning method from PU data based on the information-maximization principle. Our method does not require class-prior estimation and thus can be used as a preprocessing method for PU classification. Through experiments, we demonstrate that our method combined with deep neural networks highly improves the accuracy of PU class-prior estimation, leading to state-of-the-art PU classification performance.
Code (0)
등록된 구현이 없습니다.
Tasks
ClassificationDimensionality ReductionGeneral ClassificationRepresentation LearningWeakly Supervised ClassificationSimilar Papers 제목 키워드 기반
Active learning from positive and unlabeled examples
Learning from positive and unlabeled data (PU learning) is a weakly supervised variant of binary classification in which the learner receives labels only for (some) positively labeled instances, while all other examples …
Binary ClassificationAnomaly DetectionActive LearningEstimating the class prior and posterior from noisy positives and unlabeled data
We develop a classification algorithm for estimating posterior distributions from positive-unlabeled data, that is robust to noise in the positive labels and effective for high-dimensional data. In recent years, several …
ClassificationDensity EstimationGeneral ClassificationRobust classificationOn Positive-Unlabeled Classification in GAN
This paper defines a positive and unlabeled classification problem for standard GANs, which then leads to a novel technique to stabilize the training of the discriminator in GANs. Traditionally, real data are taken as po…
ClassificationGeneral ClassificationAnalysis of Learning from Positive and Unlabeled Data
Learning a classifier from positive and unlabeled data is an important class of classification problems that are conceivable in many practical applications. In this paper, we first show that this problem can be solved by…
General ClassificationOutlier DetectionMicro Text Classification Based on Balanced Positive-Unlabeled Learning
In real-world text classification tasks, negative texts often contain a minimal proportion of negative content, which is especially problematic in areas like text quality control, legal risk screening, and sensitive info…
text-classificationText Classification