Learning from Pixel-Level Label Noise: A New Perspective for Semi-Supervised Semantic Segmentation
This paper addresses semi-supervised semantic segmentation by exploiting a small set of images with pixel-level annotations (strong supervisions) and a large set of images with only image-level annotations (weak supervisions). Most existing approaches aim to generate accurate pixel-level labels from weak supervisions. However, we observe that those generated labels still inevitably contain noisy labels. Motivated by this observation, we present a novel perspective and formulate this task as a problem of learning with pixel-level label noise. Existing noisy label methods, nevertheless, mainly aim at image-level tasks, which can not capture the relationship between neighboring labels in one image. Therefore, we propose a graph based label noise detection and correction framework to deal with pixel-level noisy labels. In particular, for the generated pixel-level noisy labels from weak supervisions by Class Activation Map (CAM), we train a clean segmentation model with strong supervisions to detect the clean labels from these noisy labels according to the cross-entropy loss. Then, we adopt a superpixel-based graph to represent the relations of spatial adjacency and semantic similarity between pixels in one image. Finally we correct the noisy labels using a Graph Attention Network (GAT) supervised by detected clean labels. We comprehensively conduct experiments on PASCAL VOC 2012, PASCAL-Context and MS-COCO datasets. The experimental results show that our proposed semi supervised method achieves the state-of-the-art performances and even outperforms the fully-supervised models on PASCAL VOC 2012 and MS-COCO datasets in some cases.
Code (0)
등록된 구현이 없습니다.
Tasks
Graph AttentionSemantic SegmentationSemantic SimilaritySemantic Textual SimilaritySemi-Supervised Semantic SegmentationSimilar Papers 제목 키워드 기반
CamoTeacher: Dual-Rotation Consistency Learning for Semi-Supervised Camouflaged Object Detection
Existing camouflaged object detection~(COD) methods depend heavily on large-scale pixel-level annotations.However, acquiring such annotations is laborious due to the inherent camouflage characteristics of the objects.Sem…
object-detectionObject DetectionPseudo LabelSemi-Supervised Semantic Segmentation under Label Noise via Diverse Learning Groups
Semi-supervised semantic segmentation methods use a small amount of clean pixel-level annotations to guide the interpretation of a larger quantity of unlabelled image data. The challenges of providing pixel-accurate …
Semantic SegmentationSemi-Supervised Semantic SegmentationLearning from Noisy Data for Semi-Supervised 3D Object Detection
Pseudo-Labeling (PL) is a critical approach in semi-supervised 3D object detection (SSOD). In PL, delicately selected pseudo-labels, generated by the teacher model, are provided for the student model to supervise the…
3D Object Detectionobject-detectionObject DetectionPseudo Label+1Locating Noise is Halfway Denoising for Semi-Supervised Segmentation
We investigate semi-supervised semantic segmentation with self-training, where a teacher model generates pseudo masks to exploit the benefits of a large amount of unlabeled images. We notice that the noisy label from…
DenoisingSemantic SegmentationSemi-Supervised Semantic SegmentationPseudo-Label Quality Decoupling and Correction for Semi-Supervised Instance Segmentation
Semi-Supervised Instance Segmentation (SSIS) involves classifying and grouping image pixels into distinct object instances using limited labeled data. This learning paradigm usually faces a significant challenge of unsta…
Instance SegmentationPseudo LabelSemantic SegmentationSemi-Supervised Instance Segmentation