Instance-specific and Model-adaptive Supervision for Semi-supervised Semantic Segmentation
Recently, semi-supervised semantic segmentation has achieved promising performance with a small fraction of labeled data. However, most existing studies treat all unlabeled data equally and barely consider the differences and training difficulties among unlabeled instances. Differentiating unlabeled instances can promote instance-specific supervision to adapt to the model's evolution dynamically. In this paper, we emphasize the cruciality of instance differences and propose an instance-specific and model-adaptive supervision for semi-supervised semantic segmentation, named iMAS. Relying on the model's performance, iMAS employs a class-weighted symmetric intersection-over-union to evaluate quantitative hardness of each unlabeled instance and supervises the training on unlabeled data in a model-adaptive manner. Specifically, iMAS learns from unlabeled instances progressively by weighing their corresponding consistency losses based on the evaluated hardness. Besides, iMAS dynamically adjusts the augmentation for each instance such that the distortion degree of augmented instances is adapted to the model's generalization capability across the training course. Not integrating additional losses and training procedures, iMAS can obtain remarkable performance gains against current state-of-the-art approaches on segmentation benchmarks under different semi-supervised partition protocols.
Code (1)
Tasks
SegmentationSemantic SegmentationSemi-Supervised Semantic SegmentationSimilar Papers 제목 키워드 기반
Learning Cross-Representation Affinity Consistency for Sparsely Supervised Biomedical Instance Segmentation
Sparse instance-level supervision has recently been explored to address insufficient annotation in biomedical instance segmentation, which is easier to annotate crowded instances and better preserves instance complet…
Instance SegmentationPseudo LabelSemantic SegmentationPoint Cloud Instance Segmentation with Semi-supervised Bounding-Box Mining
Point cloud instance segmentation has achieved huge progress with the emergence of deep learning. However, these methods are usually data-hungry with expensive and time-consuming dense point cloud annotations. To allevia…
Instance SegmentationSemantic SegmentationLearning Saliency Propagation for Semi-Supervised Instance Segmentation
Instance segmentation is a challenging task for both modeling and annotation. Due to the high annotation cost, modeling becomes more difficult because of the limited amount of supervision. We aim to improve the accuracy …
Instance Segmentationobject-detectionObject DetectionSegmentation+2RefTeacher: A Strong Baseline for Semi-Supervised Referring Expression Comprehension
Referring expression comprehension (REC) often requires a large number of instance-level annotations for fully supervised learning, which are laborious and expensive. In this paper, we present the first attempt of se…
Imitation LearningPseudo LabelReferring ExpressionReferring Expression ComprehensionGAN Driven Semi-distant Supervision for Relation Extraction
Distant supervision has been widely used in relation extraction tasks without hand-labeled datasets recently. However, the automatically constructed datasets comprise numbers of wrongly labeled negative instances due to …
Generative Adversarial NetworkRelationRelation Extraction