Weakly-supervised Salient Instance Detection
Existing salient instance detection (SID) methods typically learn from pixel-level annotated datasets. In this paper, we present the first weakly-supervised approach to the SID problem. Although weak supervision has been considered in general saliency detection, it is mainly based on using class labels for object localization. However, it is non-trivial to use only class labels to learn instance-aware saliency information, as salient instances with high semantic affinities may not be easily separated by the labels. We note that subitizing information provides an instant judgement on the number of salient items, which naturally relates to detecting salient instances and may help separate instances of the same class while grouping different parts of the same instance. Inspired by this insight, we propose to use class and subitizing labels as weak supervision for the SID problem. We propose a novel weakly-supervised network with three branches: a Saliency Detection Branch leveraging class consistency information to locate candidate objects; a Boundary Detection Branch exploiting class discrepancy information to delineate object boundaries; and a Centroid Detection Branch using subitizing information to detect salient instance centroids. This complementary information is further fused to produce salient instance maps. We conduct extensive experiments to demonstrate that the proposed method plays favorably against carefully designed baseline methods adapted from related tasks.
Code (0)
등록된 구현이 없습니다.
Tasks
Boundary DetectionObject LocalizationSaliency DetectionSimilar Papers 제목 키워드 기반
Learning to Detect Instance-level Salient Objects Using Complementary Image Labels
Existing salient instance detection (SID) methods typically learn from pixel-level annotated datasets. In this paper, we present the first weakly-supervised approach to the SID problem. Although weak supervision has been…
Boundary DetectionObject LocalizationSaliency DetectionWeakly-supervised Instance Segmentation via Class-agnostic Learning with Salient Images
Humans have a strong class-agnostic object segmentation ability and can outline boundaries of unknown objects precisely, which motivates us to propose a box-supervised class-agnostic object segmentation (BoxCaseg) based …
Box-supervised Instance SegmentationInstance SegmentationMulti-Task LearningObject+4Associating Inter-Image Salient Instances for Weakly Supervised Semantic Segmentation
Effectively bridging between image level keyword annotations and corresponding image pixels is one of the main challenges in weakly supervised semantic segmentation. In this paper, we use an instance-level salient object…
Clusteringgraph partitioningImage-level Supervised Instance SegmentationInstance Segmentation+6Unsupervised Salient Instance Detection
The significant amount of manual efforts in annotating pixel-level labels has triggered the advancement of unsupervised saliency learning. However without supervision signals state-of-the-art methods can only infer r…
Transformer-based Multi-Instance Learning for Weakly Supervised Object Detection
Weakly Supervised Object Detection (WSOD) enables the training of object detection models using only image-level annotations. State-of-the-art WSOD detectors commonly rely on multi-instance learning (MIL) as the backbone…
Objectobject-detectionObject DetectionWeakly Supervised Object Detection