Connectivity-constrained interactive annotations for panoptic segmentation
Large-scale ground truth data sets are of crucial importance for deep learning based segmentation models, but annotating per-pixel masks is prohibitively time consuming. In this paper, we investigate interactive graph-based segmentation algorithms that enforce connectivity. To be more precise, we introduce an instance-aware heuristic of a discrete Potts model, and a class-aware Integer Linear Programming (ILP) formulation that ensures global optimum. Both algorithms can take RGB, or utilize the feature maps from any DCNN, whether trained on the target dataset or not, as input. We present competitive semantic (and panoptic) segmentation results on the PASCAL VOC 2012 and Cityscapes dataset given initial scribbles. We also demonstrate that our interactive approach can reach $90.6\%$ mIoU on VOC validation set with an overhead of just $3$ correction scribbles. They are thus suitable for interactive annotation on new or existing datasets, or can be used inside any weakly supervised learning framework on new datasets.
Code (0)
등록된 구현이 없습니다.
Tasks
Panoptic SegmentationSegmentationWeakly-supervised LearningSimilar Papers 제목 키워드 기반
Connectivity-constrained Interactive Panoptic Segmentation
We address interactive panoptic annotation, where one segment all object and stuff regions in an image. We investigate two graph-based segmentation algorithms that both enforce connectivity of each region, with a notable…
Panoptic SegmentationSegmentationVideo Panoptic Segmentation
Panoptic segmentation has become a new standard of visual recognition task by unifying previous semantic segmentation and instance segmentation tasks in concert. In this paper, we propose and explore a new video extensio…
Instance SegmentationPanoptic SegmentationSegmentationSemantic Segmentation+5Part-aware Panoptic Segmentation
In this work, we introduce the new scene understanding task of Part-aware Panoptic Segmentation (PPS), which aims to understand a scene at multiple levels of abstraction, and unifies the tasks of scene parsing and part p…
Image SegmentationPanoptic SegmentationPart-aware Panoptic SegmentationScene Parsing+2Towards Panoptic 3D Parsing for Single Image in the Wild
Performing single image holistic understanding and 3D reconstruction is a central task in computer vision. This paper presents an integrated system that performs dense scene labeling, object detection, instance segmentat…
3D Reconstruction3D Shape ReconstructionAutonomous DrivingDepth Estimation+7Panoptic Narrative Grounding
This paper proposes Panoptic Narrative Grounding, a spatially fine and general formulation of the natural language visual grounding problem. We establish an experimental framework for the study of this new task, includin…
Natural Language Visual GroundingPanoptic SegmentationVisual Grounding