ConMatch: Semi-Supervised Learning with Confidence-Guided Consistency Regularization
We present a novel semi-supervised learning framework that intelligently leverages the consistency regularization between the model's predictions from two strongly-augmented views of an image, weighted by a confidence of pseudo-label, dubbed ConMatch. While the latest semi-supervised learning methods use weakly- and strongly-augmented views of an image to define a directional consistency loss, how to define such direction for the consistency regularization between two strongly-augmented views remains unexplored. To account for this, we present novel confidence measures for pseudo-labels from strongly-augmented views by means of weakly-augmented view as an anchor in non-parametric and parametric approaches. Especially, in parametric approach, we present, for the first time, to learn the confidence of pseudo-label within the networks, which is learned with backbone model in an end-to-end manner. In addition, we also present a stage-wise training to boost the convergence of training. When incorporated in existing semi-supervised learners, ConMatch consistently boosts the performance. We conduct experiments to demonstrate the effectiveness of our ConMatch over the latest methods and provide extensive ablation studies. Code has been made publicly available at https://github.com/JiwonCocoder/ConMatch.
Code (1)
Tasks
Pseudo LabelSimilar Papers 제목 키워드 기반
Co-training with High-Confidence Pseudo Labels for Semi-supervised Medical Image Segmentation
Consistency regularization and pseudo labeling-based semi-supervised methods perform co-training using the pseudo labels from multi-view inputs. However, such co-training models tend to converge early to a consensus, deg…
Image SegmentationLeft Atrium SegmentationMedical Image SegmentationSegmentation+3Confidence-Guided Semi-supervised Learning in Land Cover Classification
Semi-supervised learning has been well developed to help reduce the cost of manual labelling by exploiting a large quantity of unlabelled data. Especially in the application of land cover classification, pixel-level manu…
ClassificationDiversityLand Cover ClassificationPseudo LabelCOIN: Confidence Score-Guided Distillation for Annotation-Free Cell Segmentation
Cell instance segmentation (CIS) is crucial for identifying individual cell morphologies in histopathological images, providing valuable insights for biological and medical research. While unsupervised CIS (UCIS) models …
Cell SegmentationInstance SegmentationSemantic SegmentationUnsupervised Semantic SegmentationUCAD: Uncertainty-guided Contour-aware Displacement for semi-supervised medical image segmentation
Existing displacement strategies in semi-supervised segmentation only operate on rectangular regions, ignoring anatomical structures and resulting in boundary distortions and semantic inconsistency. To address these issu…
Semi-supervised Medical Image SegmentationBi-CoG: Bi-Consistency-Guided Self-Training for Vision-Language Models
Exploiting unlabeled data through semi-supervised learning (SSL) or leveraging pre-trained models via fine-tuning are two prevailing paradigms for addressing label-scarce scenarios. Recently, growing attention has been g…