Weakly Supervised Graph Based Semantic Segmentation by Learning Communities of Image-Parts
We present a weakly-supervised approach to semantic segmentation. The goal is to assign pixel-level labels given only partial information, for example, image-level labels. This is an important problem in many application scenarios where it is difficult to get accurate segmentation or not feasible to obtain detailed annotations. The proposed approach starts with an initial coarse segmentation, followed by a spectral clustering approach that groups related image parts into communities. A community-driven graph is then constructed that captures spatial and feature relationships between communities while a label graph captures correlations between image labels. Finally, mapping the image level labels to appropriate communities is formulated as a convex optimization problem. The proposed approach does not require location information for image level labels and can be trained using partially labeled datasets. Compared to the state-of-the-art weakly supervised approaches, we achieve a significant performance improvement of 9% on MSRC-21 dataset and 11% on LabelMe dataset, while being more than 300 times faster.
Code (0)
등록된 구현이 없습니다.
Tasks
ClusteringPartially Labeled DatasetsSegmentationSemantic SegmentationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Affinity Attention Graph Neural Network for Weakly Supervised Semantic Segmentation
Weakly supervised semantic segmentation is receiving great attention due to its low human annotation cost. In this paper, we aim to tackle bounding box supervised semantic segmentation, i.e., training accurate semantic s…
Box-supervised Instance SegmentationGraph Neural NetworkInstance SegmentationModel Optimization+4Hypergraph Convolutional Networks for Weakly-Supervised Semantic Segmentation
Semantic segmentation is a fundamental topic in computer vision. Several deep learning methods have been proposed for semantic segmentation with outstanding results. However, these models require a lot of densely annotat…
SegmentationSemantic SegmentationWeakly supervised Semantic SegmentationWeakly-Supervised Semantic SegmentationWeakly Supervised Multiclass Video Segmentation
The desire of enabling computers to learn semantic concepts from large quantities of Internet videos has motivated increasing interests on semantic video understanding, while video segmentation is important yet challengi…
SegmentationSemantic SimilaritySemantic Textual SimilarityVideo Segmentation+3Associating Inter-Image Salient Instances for Weakly Supervised Semantic Segmentation
Effectively bridging between image level keyword annotations and corresponding image pixels is one of the main challenges in weakly supervised semantic segmentation. In this paper, we use an instance-level salient object…
Clusteringgraph partitioningImage-level Supervised Instance SegmentationInstance Segmentation+6Leveraging Instance-, Image- and Dataset-Level Information for Weakly Supervised Instance Segmentation
Weakly supervised semantic instance segmentation with only image-level supervision, instead of relying on expensive pixel wise masks or bounding box annotations, is an important problem to alleviate the data-hungry natur…
Image-level Supervised Instance SegmentationInstance SegmentationMultiple Instance LearningSegmentation+3