Semi-Supervised Semantic Segmentation with Pixel-Level Contrastive Learning from a Class-wise Memory Bank
This work presents a novel approach for semi-supervised semantic segmentation. The key element of this approach is our contrastive learning module that enforces the segmentation network to yield similar pixel-level feature representations for same-class samples across the whole dataset. To achieve this, we maintain a memory bank continuously updated with relevant and high-quality feature vectors from labeled data. In an end-to-end training, the features from both labeled and unlabeled data are optimized to be similar to same-class samples from the memory bank. Our approach outperforms the current state-of-the-art for semi-supervised semantic segmentation and semi-supervised domain adaptation on well-known public benchmarks, with larger improvements on the most challenging scenarios, i.e., less available labeled data. https://github.com/Shathe/SemiSeg-Contrastive
Code (1)
Tasks
Contrastive LearningDomain AdaptationRepresentation LearningSegmentationSemantic SegmentationSemi-supervised Domain AdaptationSemi-Supervised Semantic SegmentationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Region-level Contrastive and Consistency Learning for Semi-Supervised Semantic Segmentation
Current semi-supervised semantic segmentation methods mainly focus on designing pixel-level consistency and contrastive regularization. However, pixel-level regularization is sensitive to noise from pixels with incorrect…
SegmentationSemantic SegmentationSemi-Supervised Semantic SegmentationBootstrapping Semantic Segmentation with Regional Contrast
We present ReCo, a contrastive learning framework designed at a regional level to assist learning in semantic segmentation. ReCo performs semi-supervised or supervised pixel-level contrastive learning on a sparse set of …
Contrastive LearningSegmentationSemantic SegmentationSemi-Supervised Semantic SegmentationSemi-Supervised Semantic Segmentation with High- and Low-level Consistency
The ability to understand visual information from limited labeled data is an important aspect of machine learning. While image-level classification has been extensively studied in a semi-supervised setting, dense pixel-l…
ClassificationGeneral ClassificationSegmentationSemantic Segmentation+2Pixel Contrastive-Consistent Semi-Supervised Semantic Segmentation
We present a novel semi-supervised semantic segmentation method which jointly achieves two desiderata of segmentation model regularities: the label-space consistency property between image augmentations and the feature-s…
Computational EfficiencySegmentationSemantic SegmentationSemi-Supervised Semantic SegmentationStructured Consistency Loss for semi-supervised semantic segmentation
The consistency loss has played a key role in solving problems in recent studies on semi-supervised learning. Yet extant studies with the consistency loss are limited to its application to classification tasks; extant st…
General ClassificationSegmentationSemantic SegmentationSemi-Supervised Semantic Segmentation