paper-with-me

홈 › Papers

CoVar: Confidence-Variance-Guided Pseudo-Label Selection for Semi-Supervised Learning

2026-01-16 · Jinshi Liu, Lei He, Pan Liu arxiv

Pseudo-label selection in semi-supervised learning is commonly driven by maximum-confidence thresholds, yet confidence alone can be unreliable under model overconfidence and class imbalance. We propose CoVar, a confidence--variance framework that assesses pseudo-label reliability by jointly modeling Maximum Confidence (MC) and Residual-Class Variance (RCV). Starting from entropy minimization, we derive a second-order cross-entropy approximation showing that low-loss pseudo-labels are favored when MC is high and RCV is low, with a confidence-dependent penalty that becomes stronger for near-certain predictions. Based on this criterion, CoVar embeds predictions into a two-dimensional confidence--variance space and uses SVD-based spectral relaxation to separate reliable and unreliable predictions without hand-tuned confidence thresholds. Cluster-wise Gaussian weighting then converts this separation into per-sample training weights. The resulting weights can be integrated into existing semi-supervised segmentation and classification pipelines during training and introduce no inference-time overhead. Experiments on PASCAL VOC 2012, Cityscapes, CIFAR-10, CIFAR-100, SVHN, and STL-10 show clear gains on VOC and Cityscapes under matched backbones, as well as competitive or improved error rates on standard classification benchmarks. These results indicate that residual-class dispersion provides a useful signal complementary to confidence for robust pseudo-label selection.

📄 PDF Abstract BibTeX arXiv:2601.11670

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Towards Self-Supervised Covariance Estimation in Deep Heteroscedastic Regression

2025-02-14 · Megh Shukla, Aziz Shameem, Mathieu Salzmann, Alexandre Alahi

Deep heteroscedastic regression models the mean and covariance of the target distribution through neural networks. The challenge arises from heteroscedasticity, which implies that the covariance is sample dependent and i…

Pseudo Labelregression

Confidence-guided Centroids for Unsupervised Person Re-Identification

2022-11-22 · Yunqi Miao, Jiankang Deng, Guiguang Ding, Jungong Han

Unsupervised person re-identification (ReID) aims to train a feature extractor for identity retrieval without exploiting identity labels. Due to the blind trust in imperfect clustering results, the learning is inevitably…

Person Re-IdentificationPseudo LabelRetrievalUnsupervised Person Re-Identification

Co-training with High-Confidence Pseudo Labels for Semi-supervised Medical Image Segmentation

2023-01-11 · Zhiqiang Shen, Peng Cao, Hua Yang, Xiaoli Liu 외

Consistency regularization and pseudo labeling-based semi-supervised methods perform co-training using the pseudo labels from multi-view inputs. However, such co-training models tend to converge early to a consensus, deg…

Image SegmentationLeft Atrium SegmentationMedical Image SegmentationSegmentation+3

Unified Entropy Optimization for Open-Set Test-Time Adaptation

2024-04-09 · CVPR 2024 1 · Zhengqing Gao, Xu-Yao Zhang, Cheng-Lin Liu

Test-time adaptation (TTA) aims at adapting a model pre-trained on the labeled source domain to the unlabeled target domain. Existing methods usually focus on improving TTA performance under covariate shifts, while negle…

Test-time Adaptation

Confidence-Guided Semi-supervised Learning in Land Cover Classification

2023-05-17 · Wanli Ma, Oktay Karakus, Paul L. Rosin

Semi-supervised learning has been well developed to help reduce the cost of manual labelling by exploiting a large quantity of unlabelled data. Especially in the application of land cover classification, pixel-level manu…

ClassificationDiversityLand Cover ClassificationPseudo Label