A Three-Stage Self-Training Framework for Semi-Supervised Semantic Segmentation
Semantic segmentation has been widely investigated in the community, in which the state of the art techniques are based on supervised models. Those models have reported unprecedented performance at the cost of requiring a large set of high quality segmentation masks. To obtain such annotations is highly expensive and time consuming, in particular, in semantic segmentation where pixel-level annotations are required. In this work, we address this problem by proposing a holistic solution framed as a three-stage self-training framework for semi-supervised semantic segmentation. The key idea of our technique is the extraction of the pseudo-masks statistical information to decrease uncertainty in the predicted probability whilst enforcing segmentation consistency in a multi-task fashion. We achieve this through a three-stage solution. Firstly, we train a segmentation network to produce rough pseudo-masks which predicted probability is highly uncertain. Secondly, we then decrease the uncertainty of the pseudo-masks using a multi-task model that enforces consistency whilst exploiting the rich statistical information of the data. We compare our approach with existing methods for semi-supervised semantic segmentation and demonstrate its state-of-the-art performance with extensive experiments.
Code (1)
Tasks
SegmentationSemantic SegmentationSemi-Supervised Semantic SegmentationSimilar Papers 제목 키워드 기반
Pelvic floor MRI segmentation based on semi-supervised deep learning
The semantic segmentation of pelvic organs via MRI has important clinical significance. Recently, deep learning-enabled semantic segmentation has facilitated the three-dimensional geometric reconstruction of pelvic floor…
Deep LearningDiagnosticImage RestorationMRI segmentation+3Semi-Supervised Text Classification via Self-Pretraining
We present a neural semi-supervised learning model termed Self-Pretraining. Our model is inspired by the classic self-training algorithm. However, as opposed to self-training, Self-Pretraining is threshold-free, it can p…
Pseudo LabelSemi-Supervised Text ClassificationText ClassificationPred&Guide: Labeled Target Class Prediction for Guiding Semi-Supervised Domain Adaptation
Semi-supervised domain adaptation aims to classify data belonging to a target domain by utilizing a related label-rich source domain and very few labeled examples of the target domain. Here, we propose a novel framework,…
Domain AdaptationSemi-supervised Domain AdaptationUnsupervised Domain AdaptationThe GIST and RIST of Iterative Self-Training for Semi-Supervised Segmentation
We consider the task of semi-supervised semantic segmentation, where we aim to produce pixel-wise semantic object masks given only a small number of human-labeled training examples. We focus on iterative self-training me…
Semantic SegmentationSemi-Supervised Semantic SegmentationSemiReward: A General Reward Model for Semi-supervised Learning
Semi-supervised learning (SSL) has witnessed great progress with various improvements in the self-training framework with pseudo labeling. The main challenge is how to distinguish high-quality pseudo labels against the c…
Few-Shot Image ClassificationImage ClassificationPseudo LabelSemi-supervised Audio Classification+3