Weakly Supervised Semantic Segmentation using Web-Crawled Videos
We propose a novel algorithm for weakly supervised semantic segmentation based on image-level class labels only. In weakly supervised setting, it is commonly observed that trained model overly focuses on discriminative parts rather than the entire object area. Our goal is to overcome this limitation with no additional human intervention by retrieving videos relevant to target class labels from web repository, and generating segmentation labels from the retrieved videos to simulate strong supervision for semantic segmentation. During this process, we take advantage of image classification with discriminative localization technique to reject false alarms in retrieved videos and identify relevant spatio-temporal volumes within retrieved videos. Although the entire procedure does not require any additional supervision, the segmentation annotations obtained from videos are sufficiently strong to learn a model for semantic segmentation. The proposed algorithm substantially outperforms existing methods based on the same level of supervision and is even as competitive as the approaches relying on extra annotations.
Code (0)
등록된 구현이 없습니다.
Tasks
image-classificationImage ClassificationSegmentationSemantic SegmentationWeakly supervised Semantic SegmentationWeakly-Supervised Semantic SegmentationSimilar Papers 제목 키워드 기반
WebSeg: Learning Semantic Segmentation from Web Searches
In this paper, we improve semantic segmentation by automatically learning from Flickr images associated with a particular keyword, without relying on any explicit user annotations, thus substantially alleviating the depe…
DiversitySegmentationSemantic SegmentationWeakly Supervised Multiclass Video Segmentation
The desire of enabling computers to learn semantic concepts from large quantities of Internet videos has motivated increasing interests on semantic video understanding, while video segmentation is important yet challengi…
SegmentationSemantic SimilaritySemantic Textual SimilarityVideo Segmentation+3Hierarchical Modeling for Task Recognition and Action Segmentation in Weakly-Labeled Instructional Videos
This paper focuses on task recognition and action segmentation in weakly-labeled instructional videos, where only the ordered sequence of video-level actions is available during training. We propose a two-stream framewor…
Action SegmentationSegmentationBootstrapping the Performance of Webly Supervised Semantic Segmentation
Fully supervised methods for semantic segmentation require pixel-level class masks to train, the creation of which are expensive in terms of manual labour and time. In this work, we focus on weak supervision, developing …
SegmentationSemantic SegmentationTransfer LearningWeakly supervised Semantic Segmentation+1Rewis3d: Reconstruction Improves Weakly-Supervised Semantic Segmentation
We present Rewis3d, a framework that leverages recent advances in feed-forward 3D reconstruction to significantly improve weakly supervised semantic segmentation on 2D images. Obtaining dense, pixel-level annotations rem…
Weakly-Supervised Semantic Segmentation3D ReconstructionPoint Clouds