Semi-supervised learning by selective training with pseudo labels via confidence estimation
We propose a novel semi-supervised learning (SSL) method that adopts selective training with pseudo labels. In our method, we generate hard pseudo-labels and also estimate their confidence, which represents how likely each pseudo-label is to be correct. Then, we explicitly select which pseudo-labeled data should be used to update the model. Specifically, assuming that loss on incorrectly pseudo-labeled data sensitively increase against data augmentation, we select the data corresponding to relatively small loss after applying data augmentation. The confidence is used not only for screening candidates of pseudo-labeled data to be selected but also for automatically deciding how many pseudo-labeled data should be selected within a mini-batch. Since accurate estimation of the confidence is crucial in our method, we also propose a new data augmentation method, called MixConf, that enables us to obtain confidence-calibrated models even when the number of training data is small. Experimental results with several benchmark datasets validate the advantage of our SSL method as well as MixConf.
Code (0)
등록된 구현이 없습니다.
Tasks
Data AugmentationPseudo LabelSimilar Papers 제목 키워드 기반
Semi-Supervised Domain Adaptation via Selective Pseudo Labeling and Progressive Self-Training
Domain adaptation (DA) is a representation learning methodology that transfers knowledge from a label-sufficient source domain to a label-scarce target domain. While most of early methods are focused on unsupervised DA (…
Domain AdaptationRepresentation LearningSemi-supervised Domain AdaptationSelective Pseudo-Labeling with Reinforcement Learning for Semi-Supervised Domain Adaptation
Recent domain adaptation methods have demonstrated impressive improvement on unsupervised domain adaptation problems. However, in the semi-supervised domain adaptation (SSDA) setting where the target domain has a few lab…
Domain AdaptationQ-Learningreinforcement-learningReinforcement Learning (RL)+2Sparse Semi-DETR: Sparse Learnable Queries for Semi-Supervised Object Detection
In this paper, we address the limitations of the DETR-based semi-supervised object detection (SSOD) framework, particularly focusing on the challenges posed by the quality of object queries. In DETR-based SSOD, the one-t…
Objectobject-detectionObject DetectionPseudo Label+2Navigating Data Heterogeneity in Federated Learning A Semi-Supervised Federated Object Detection
Federated Learning (FL) has emerged as a potent framework for training models across distributed data sources while maintaining data privacy. Nevertheless, it faces challenges with limited high-quality labels and non-IID…
Autonomous DrivingFederated LearningNavigateobject-detection+3Navigating Data Heterogeneity in Federated Learning: A Semi-Supervised Approach for Object Detection
Federated Learning (FL) has emerged as a potent framework for training models across distributed data sources while maintaining data privacy. Nevertheless, it faces challenges with limited high-quality labels and non-IID…