Unsupervised Selective Labeling for More Effective Semi-Supervised Learning
Given an unlabeled dataset and an annotation budget, we study how to selectively label a fixed number of instances so that semi-supervised learning (SSL) on such a partially labeled dataset is most effective. We focus on selecting the right data to label, in addition to usual SSL's propagating labels from labeled data to the rest unlabeled data. This instance selection task is challenging, as without any labeled data we do not know what the objective of learning should be. Intuitively, no matter what the downstream task is, instances to be labeled must be representative and diverse: The former would facilitate label propagation to unlabeled data, whereas the latter would ensure coverage of the entire dataset. We capture this idea by selecting cluster prototypes, either in a pretrained feature space, or along with feature optimization, both without labels. Our unsupervised selective labeling consistently improves SSL methods over state-of-the-art active learning given labeled data, by 8 to 25 times in label efficiency. For example, it boosts FixMatch by 10% (14%) in accuracy on CIFAR-10 (ImageNet-1K) with 0.08% (0.2%) labeled data, demonstrating that small computation spent on selecting what data to label brings significant gain especially under a low annotation budget. Our work sets a new standard for practical and efficient SSL.
Code (1)
Tasks
Active LearningSemi-Supervised Image Classification (Cold Start)Methods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Selective Pseudo-Labeling with Reinforcement Learning for Semi-Supervised Domain Adaptation
Recent domain adaptation methods have demonstrated impressive improvement on unsupervised domain adaptation problems. However, in the semi-supervised domain adaptation (SSDA) setting where the target domain has a few lab…
Domain AdaptationQ-Learningreinforcement-learningReinforcement Learning (RL)+2Cold PAWS: Unsupervised class discovery and addressing the cold-start problem for semi-supervised learning
In many machine learning applications, labeling datasets can be an arduous and time-consuming task. Although research has shown that semi-supervised learning techniques can achieve high accuracy with very few labels with…
Self-Supervised LearningSemi-Supervised Domain Adaptation via Selective Pseudo Labeling and Progressive Self-Training
Domain adaptation (DA) is a representation learning methodology that transfers knowledge from a label-sufficient source domain to a label-scarce target domain. While most of early methods are focused on unsupervised DA (…
Domain AdaptationRepresentation LearningSemi-supervised Domain AdaptationUnsupervised Domain Adaptation via Structured Prediction Based Selective Pseudo-Labeling
Unsupervised domain adaptation aims to address the problem of classifying unlabeled samples from the target domain whilst labeled samples are only available from the source domain and the data distributions are different…
ClusteringDomain AdaptationStructured PredictionUnsupervised Domain AdaptationCombining Self-labeling with Selective Sampling
Since data is the fuel that drives machine learning models, and access to labeled data is generally expensive, semi-supervised methods are constantly popular. They enable the acquisition of large datasets without the nee…
Active Learning