Panoptic Segmentation
We propose and study a task we name panoptic segmentation (PS). Panoptic segmentation unifies the typically distinct tasks of semantic segmentation (assign a class label to each pixel) and instance segmentation (detect and segment each object instance). The proposed task requires generating a coherent scene segmentation that is rich and complete, an important step toward real-world vision systems. While early work in computer vision addressed related image/scene parsing tasks, these are not currently popular, possibly due to lack of appropriate metrics or associated recognition challenges. To address this, we propose a novel panoptic quality (PQ) metric that captures performance for all classes (stuff and things) in an interpretable and unified manner. Using the proposed metric, we perform a rigorous study of both human and machine performance for PS on three existing datasets, revealing interesting insights about the task. The aim of our work is to revive the interest of the community in a more unified view of image segmentation.
Code (9)
Tasks
Image SegmentationInstance SegmentationPanoptic SegmentationScene ParsingScene SegmentationSegmentationSemantic SegmentationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
PVO: Panoptic Visual Odometry
We present PVO, a novel panoptic visual odometry framework to achieve more comprehensive modeling of the scene motion, geometry, and panoptic segmentation information. Our PVO models visual odometry (VO) and video panopt…
Camera Pose EstimationOptical Flow EstimationPanoptic SegmentationPose Estimation+3Panoptic-PolarNet: Proposal-free LiDAR Point Cloud Panoptic Segmentation
Panoptic segmentation presents a new challenge in exploiting the merits of both detection and segmentation, with the aim of unifying instance segmentation and semantic segmentation in a single framework. However, an effi…
ClusteringInstance SegmentationPanoptic SegmentationSegmentation+1Single-shot Path Integrated Panoptic Segmentation
Panoptic segmentation, which is a novel task of unifying instance segmentation and semantic segmentation, has attracted a lot of attention lately. However, most of the previous methods are composed of multiple pathways w…
Instance SegmentationPanoptic SegmentationSegmentationSemantic SegmentationAn End-to-End Trainable Video Panoptic Segmentation Method usingTransformers
In this paper, we present an algorithm to tackle a video panoptic segmentation problem, a newly emerging area of research. The video panoptic segmentation is a task that unifies the typical task of panoptic segmentation …
Multi-Object TrackingObject TrackingPanoptic SegmentationSegmentation+1Video Panoptic Segmentation
Panoptic segmentation has become a new standard of visual recognition task by unifying previous semantic segmentation and instance segmentation tasks in concert. In this paper, we propose and explore a new video extensio…
Instance SegmentationPanoptic SegmentationSegmentationSemantic Segmentation+5