Bootstrapping Semantic Segmentation with Regional Contrast
We present ReCo, a contrastive learning framework designed at a regional level to assist learning in semantic segmentation. ReCo performs semi-supervised or supervised pixel-level contrastive learning on a sparse set of hard negative pixels, with minimal additional memory footprint. ReCo is easy to implement, being built on top of off-the-shelf segmentation networks, and consistently improves performance in both semi-supervised and supervised semantic segmentation methods, achieving smoother segmentation boundaries and faster convergence. The strongest effect is in semi-supervised learning with very few labels. With ReCo, we achieve high-quality semantic segmentation models, requiring only 5 examples of each semantic class. Code is available at https://github.com/lorenmt/reco.
Code (2)
Tasks
Contrastive LearningSegmentationSemantic SegmentationSemi-Supervised Semantic SegmentationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Domain Adaptive Semantic Segmentation via Regional Contrastive Consistency Regularization
Unsupervised domain adaptation (UDA) for semantic segmentation has been well-studied in recent years. However, most existing works largely neglect the local regional consistency across different domains and are less robu…
Domain AdaptationSemantic SegmentationSynthetic-to-Real TranslationUnsupervised Domain AdaptationRegional Semantic Contrast and Aggregation for Weakly Supervised Semantic Segmentation
Learning semantic segmentation from weakly-labeled (e.g., image tags only) data is challenging since it is hard to infer dense object regions from sparse semantic tags. Despite being broadly studied, most current efforts…
ObjectSemantic SegmentationWeakly supervised Semantic SegmentationWeakly-Supervised Semantic SegmentationCYBORGS: Contrastively Bootstrapping Object Representations by Grounding in Segmentation
Many recent approaches in contrastive learning have worked to close the gap between pretraining on iconic images like ImageNet and pretraining on complex scenes like COCO. This gap exists largely because commonly used ra…
Contrastive LearningObjectSegmentationRANet: Region Attention Network for Semantic Segmentation
Recent semantic segmentation methods model the relationship between pixels to construct the contextual representations. In this paper, we introduce the \emph{Region Attention Network} (RANet), a novel attention network f…
ObjectSegmentationSemantic SegmentationPIE: Physics-inspired Low-light Enhancement
In this paper, we propose a physics-inspired contrastive learning paradigm for low-light enhancement, called PIE. PIE primarily addresses three issues: (i) To resolve the problem of existing learning-based methods often …
Contrastive LearningFace DetectionSemantic Segmentation