CoVar: Confidence-Variance-Guided Pseudo-Label Selection for Semi-Supervised Learning
Pseudo-label selection in semi-supervised learning is commonly driven by maximum-confidence thresholds, yet confidence alone can be unreliable under model overconfidence and class imbalance. We propose CoVar, a confidence--variance framework that assesses pseudo-label reliability by jointly modeling Maximum Confidence (MC) and Residual-Class Variance (RCV). Starting from entropy minimization, we derive a second-order cross-entropy approximation showing that low-loss pseudo-labels are favored when MC is high and RCV is low, with a confidence-dependent penalty that becomes stronger for near-certain predictions. Based on this criterion, CoVar embeds predictions into a two-dimensional confidence--variance space and uses SVD-based spectral relaxation to separate reliable and unreliable predictions without hand-tuned confidence thresholds. Cluster-wise Gaussian weighting then converts this separation into per-sample training weights. The resulting weights can be integrated into existing semi-supervised segmentation and classification pipelines during training and introduce no inference-time overhead. Experiments on PASCAL VOC 2012, Cityscapes, CIFAR-10, CIFAR-100, SVHN, and STL-10 show clear gains on VOC and Cityscapes under matched backbones, as well as competitive or improved error rates on standard classification benchmarks. These results indicate that residual-class dispersion provides a useful signal complementary to confidence for robust pseudo-label selection.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Towards Self-Supervised Covariance Estimation in Deep Heteroscedastic Regression
Deep heteroscedastic regression models the mean and covariance of the target distribution through neural networks. The challenge arises from heteroscedasticity, which implies that the covariance is sample dependent and i…
Pseudo LabelregressionConfidence-guided Centroids for Unsupervised Person Re-Identification
Unsupervised person re-identification (ReID) aims to train a feature extractor for identity retrieval without exploiting identity labels. Due to the blind trust in imperfect clustering results, the learning is inevitably…
Person Re-IdentificationPseudo LabelRetrievalUnsupervised Person Re-IdentificationCo-training with High-Confidence Pseudo Labels for Semi-supervised Medical Image Segmentation
Consistency regularization and pseudo labeling-based semi-supervised methods perform co-training using the pseudo labels from multi-view inputs. However, such co-training models tend to converge early to a consensus, deg…
Image SegmentationLeft Atrium SegmentationMedical Image SegmentationSegmentation+3Unified Entropy Optimization for Open-Set Test-Time Adaptation
Test-time adaptation (TTA) aims at adapting a model pre-trained on the labeled source domain to the unlabeled target domain. Existing methods usually focus on improving TTA performance under covariate shifts, while negle…
Test-time AdaptationConfidence-Guided Semi-supervised Learning in Land Cover Classification
Semi-supervised learning has been well developed to help reduce the cost of manual labelling by exploiting a large quantity of unlabelled data. Especially in the application of land cover classification, pixel-level manu…
ClassificationDiversityLand Cover ClassificationPseudo Label