Weakly-Supervised Semantic Segmentation Network With Deep Seeded Region Growing
This paper studies the problem of learning image semantic segmentation networks only using image-level labels as supervision, which is important since it can significantly reduce human annotation efforts. Recent state-of-the-art methods on this problem first infer the sparse and discriminative regions for each object class using a deep classification network, then train semantic a segmentation network using the discriminative regions as supervision. Inspired by the traditional image segmentation methods of seeded region growing, we propose to train a semantic segmentation network starting from the discriminative regions and progressively increase the pixel-level supervision using by seeded region growing. The seeded region growing module is integrated in a deep segmentation network and can benefit from deep features. Different from conventional deep networks which have fixed/static labels, the proposed weakly-supervised network generates new labels using the contextual information within an image. The proposed method significantly outperforms the weakly-supervised semantic segmentation methods using static labels, and obtains the state-of-the-art performance, which are 63.2% mIoU score on the PASCAL VOC 2012 test set and 26.0% mIoU score on the COCO dataset.
Code (1)
Tasks
Image SegmentationSegmentationSemantic SegmentationWeakly supervised Semantic SegmentationWeakly-Supervised Semantic SegmentationSimilar Papers 제목 키워드 기반
Saliency guided deep network for weakly-supervised image segmentation
Weakly-supervised image segmentation is an important task in computer vision. A key problem is how to obtain high quality objects location from image-level category. Classification activation mapping is a common method w…
Image SegmentationSegmentationSemantic SegmentationAdversarial Seeded Sequence Growing for Weakly-Supervised Temporal Action Localization
Temporal action localization is an important yet challenging research topic due to its various applications. Since the frame-level or segment-level annotations of untrimmed videos require amounts of labor expenditure, st…
Action DetectionAction LocalizationTemporal Action LocalizationWeakly-supervised Temporal Action LocalizationMulti-Miner: Object-Adaptive Region Mining for Weakly-Supervised Semantic Segmentation
Object region mining is a critical step for weakly-supervised semantic segmentation. Most recent methods mine the object regions by expanding the seed regions localized by class activation maps. They generally do not con…
ObjectSegmentationSemantic SegmentationWeakly supervised Semantic Segmentation+1Anti-Adversarially Manipulated Attributions for Weakly and Semi-Supervised Semantic Segmentation
Weakly supervised semantic segmentation produces a pixel-level localization from a classifier, but it is likely to restrict its focus to a small discriminative region of the target object. AdvCAM is an attribution map of…
Adversarial AttackObjectSegmentationSemantic Segmentation+3Closed-Loop Adaptation for Weakly-Supervised Semantic Segmentation
Weakly-supervised semantic segmentation aims to assign each pixel a semantic category under weak supervisions, such as image-level tags. Most of existing weakly-supervised semantic segmentation methods do not use any fee…
SegmentationSemantic SegmentationSuperpixelsWeakly supervised Semantic Segmentation+1