Instance Segmentation with Point Supervision
Instance segmentation methods often require costly per-pixel labels. We propose a method that only requires point-level annotations. During training, the model only has access to a single pixel label per object, yet the task is to output full segmentation masks. To address this challenge, we construct a network with two branches: (1) a localization network (L-Net) that predicts the location of each object; and (2) an embedding network (E-Net) that learns an embedding space where pixels of the same object are close. The segmentation masks for the located objects are obtained by grouping pixels with similar embeddings. At training time, while L-Net only requires point-level annotations, E-Net uses pseudo-labels generated by a class-agnostic object proposal method. We evaluate our approach on PASCAL VOC, COCO, KITTI and CityScapes datasets. The experiments show that our method (1) obtains competitive results compared to fully-supervised methods in certain scenarios; (2) outperforms fully- and weakly- supervised methods with a fixed annotation budget; and (3) is a first strong baseline for instance segmentation with point-level supervision.
Code (0)
등록된 구현이 없습니다.
Tasks
Instance SegmentationObjectSegmentationSemantic SegmentationSimilar Papers 제목 키워드 기반
Pointly-Supervised Instance Segmentation
We propose an embarrassingly simple point annotation scheme to collect weak supervision for instance segmentation. In addition to bounding boxes, we collect binary labels for a set of points uniformly sampled inside each…
Instance SegmentationObjectSegmentationSemantic Segmentation+1SegGroup: Seg-Level Supervision for 3D Instance and Semantic Segmentation
Most existing point cloud instance and semantic segmentation methods rely heavily on strong supervision signals, which require point-level labels for every point in the scene. However, such strong supervision suffers fro…
3D Instance Segmentation3D Semantic SegmentationSegmentationGaPro: Box-Supervised 3D Point Cloud Instance Segmentation Using Gaussian Processes as Pseudo Labelers
Instance segmentation on 3D point clouds (3DIS) is a longstanding challenge in computer vision, where state-of-the-art methods are mainly based on full supervision. As annotating ground truth dense instance masks is tedi…
3D Instance SegmentationGaussian ProcessesInstance SegmentationSegmentation+1Sketchy Bounding-box Supervision for 3D Instance Segmentation
Bounding box supervision has gained considerable attention in weakly supervised 3D instance segmentation. While this approach alleviates the need for extensive point-level annotations, obtaining accurate bounding boxes i…
3D Instance SegmentationInstance SegmentationSemantic SegmentationActive Pointly-Supervised Instance Segmentation
The requirement of expensive annotations is a major burden for training a well-performed instance segmentation model. In this paper, we present an economic active learning setting, named active pointly-supervised instanc…
Active LearningInstance SegmentationSegmentationSemantic Segmentation