AllMatch: Exploiting All Unlabeled Data for Semi-Supervised Learning
Existing semi-supervised learning algorithms adopt pseudo-labeling and consistency regulation techniques to introduce supervision signals for unlabeled samples. To overcome the inherent limitation of threshold-based pseudo-labeling, prior studies have attempted to align the confidence threshold with the evolving learning status of the model, which is estimated through the predictions made on the unlabeled data. In this paper, we further reveal that classifier weights can reflect the differentiated learning status across categories and consequently propose a class-specific adaptive threshold mechanism. Additionally, considering that even the optimal threshold scheme cannot resolve the problem of discarding unlabeled samples, a binary classification consistency regulation approach is designed to distinguish candidate classes from negative options for all unlabeled samples. By combining the above strategies, we present a novel SSL algorithm named AllMatch, which achieves improved pseudo-label accuracy and a 100% utilization ratio for the unlabeled data. We extensively evaluate our approach on multiple benchmarks, encompassing both balanced and imbalanced settings. The results demonstrate that AllMatch consistently outperforms existing state-of-the-art methods.
Code (0)
등록된 구현이 없습니다.
Tasks
AllBinary ClassificationClassification ConsistencyPseudo LabelMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Improving 3D Semi-supervised Learning by Effectively Utilizing All Unlabelled Data
Semi-supervised learning (SSL) has shown its effectiveness in learning effective 3D representation from a small amount of labelled data while utilizing large unlabelled data. Traditional semi-supervised approaches rely o…
3D Classification3D Object RecognitionRobust Semi-Supervised Learning in Open Environments
Semi-supervised learning (SSL) aims to improve performance by exploiting unlabeled data when labels are scarce. Conventional SSL studies typically assume close environments where important factors (e.g., label, feature, …
Leveraging Semi-Supervised Learning for Fairness using Neural Networks
There has been a growing concern about the fairness of decision-making systems based on machine learning. The shortage of labeled data has been always a challenging problem facing machine learning based systems. In such …
BIG-bench Machine LearningDecision MakingFairnessDivideMix: Learning with Noisy Labels as Semi-supervised Learning
Deep neural networks are known to be annotation-hungry. Numerous efforts have been devoted to reducing the annotation cost when learning with deep networks. Two prominent directions include learning with noisy labels and…
Image ClassificationLearning with noisy labelsExploiting Unlabeled Data in Smart Cities using Federated Learning
Privacy concerns are considered one of the main challenges in smart cities as sharing sensitive data brings threatening problems to people's lives. Federated learning has emerged as an effective technique to avoid privac…
Federated Learning