Parallel Detection-and-Segmentation Learning for Weakly Supervised Instance Segmentation
Weakly supervised instance segmentation (WSIS) with only image-level labels has recently drawn much attention. To date, bottom-up WSIS methods refine discriminative cues from classifiers with sophisticated multi-stage training procedures, which also suffer from inconsistent object boundaries. And top-down WSIS methods are formulated as cascade detection-to-segmentation pipeline, in which the quality of segmentation learning heavily depends on pseudo masks generated from detectors. In this paper, we propose a unified parallel detection-and-segmentation learning (PDSL) framework to learn instance segmentation with only image-level labels, which draws inspiration from both top-down and bottom-up instance segmentation approaches. The detection module is the same as the typical design of any weakly supervised object detection, while the segmentation module leverages self-supervised learning to model class-agnostic foreground extraction, following by self-training to refine class-specific segmentation. We further design instance-activation correlation module to improve the coherence between detection and segmentation branches. Extensive experiments verify that the proposed method outperforms baselines and achieves the state-of-the-art results on PASCAL VOC and MS COCO.
Code (0)
등록된 구현이 없습니다.
Tasks
Instance Segmentationobject-detectionObject DetectionSegmentationSelf-Supervised LearningSemantic SegmentationWeakly-supervised instance segmentationWeakly Supervised Object DetectionSimilar Papers 제목 키워드 기반
Toward Joint Thing-and-Stuff Mining for Weakly Supervised Panoptic Segmentation
Panoptic segmentation aims to partition an image to object instances and semantic content for thing and stuff categories, respectively. To date, learning weakly supervised panoptic segmentation (WSPS) with only image…
Instance SegmentationMultiple Instance LearningObjectobject-detection+6Multi-Evidence Filtering and Fusion for Multi-Label Classification, Object Detection and Semantic Segmentation Based on Weakly Supervised Learning
Supervised object detection and semantic segmentation require object or even pixel level annotations. When there exist image level labels only, it is challenging for weakly supervised algorithms to achieve accurate predi…
ClusteringGeneral Classificationimage-classificationImage Classification+15Weakly Supervised Instance Segmentation by Deep Community Learning
We present a weakly supervised instance segmentation algorithm based on deep community learning with multiple tasks. This task is formulated as a combination of weakly supervised object detection and semantic segmentatio…
Image-level Supervised Instance SegmentationInstance Segmentationobject-detectionObject Detection+4Simple Does It: Weakly Supervised Instance and Semantic Segmentation
Semantic labelling and instance segmentation are two tasks that require particularly costly annotations. Starting from weak supervision in the form of bounding box detection annotations, we propose a new approach that do…
Instance SegmentationSegmentationSemantic SegmentationPWISeg: Point-based Weakly-supervised Instance Segmentation for Surgical Instruments
In surgical procedures, correct instrument counting is essential. Instance segmentation is a location method that locates not only an object's bounding box but also each pixel's specific details. However, obtaining mask-…
Instance SegmentationSegmentationSemantic SegmentationSurgical tool detection+2