Single-shot Path Integrated Panoptic Segmentation
Panoptic segmentation, which is a novel task of unifying instance segmentation and semantic segmentation, has attracted a lot of attention lately. However, most of the previous methods are composed of multiple pathways with each pathway specialized to a designated segmentation task. In this paper, we propose to resolve panoptic segmentation in single-shot by integrating the execution flows. With the integrated pathway, a unified feature map called Panoptic-Feature is generated, which includes the information of both things and stuffs. Panoptic-Feature becomes more sophisticated by auxiliary problems that guide to cluster pixels that belong to the same instance and differentiate between objects of different classes. A collection of convolutional filters, where each filter represents either a thing or stuff, is applied to Panoptic-Feature at once, materializing the single-shot panoptic segmentation. Taking the advantages of both top-down and bottom-up approaches, our method, named SPINet, enjoys high efficiency and accuracy on major panoptic segmentation benchmarks: COCO and Cityscapes.
Code (0)
등록된 구현이 없습니다.
Tasks
Instance SegmentationPanoptic SegmentationSegmentationSemantic SegmentationSimilar Papers 제목 키워드 기반
Single-Shot Panoptic Segmentation
We present a novel end-to-end single-shot method that segments countable object instances (things) as well as background regions (stuff) into a non-overlapping panoptic segmentation at almost video frame rate. Current st…
DecoderInstance SegmentationObjectobject-detection+4Auto-Panoptic: Cooperative Multi-Component Architecture Search for Panoptic Segmentation
Panoptic segmentation is posed as a new popular test-bed for the state-of-the-art holistic scene understanding methods with the requirement of simultaneously segmenting both foreground things and background stuff. The st…
Instance SegmentationPanoptic SegmentationScene UnderstandingSegmentation+1Panoptic-DeepLab
We present Panoptic-DeepLab, a bottom-up and single-shot approach for panoptic segmentation. Our Panoptic-DeepLab is conceptually simple and delivers state-of-the-art results. In particular, we adopt the dual-ASPP and du…
DecoderInstance SegmentationPanoptic Segmentationregression+2Towards Panoptic 3D Parsing for Single Image in the Wild
Performing single image holistic understanding and 3D reconstruction is a central task in computer vision. This paper presents an integrated system that performs dense scene labeling, object detection, instance segmentat…
3D Reconstruction3D Shape ReconstructionAutonomous DrivingDepth Estimation+7DeeperLab: Single-Shot Image Parser
We present a single-shot, bottom-up approach for whole image parsing. Whole image parsing, also known as Panoptic Segmentation, generalizes the tasks of semantic segmentation for 'stuff' classes and instance segmentation…
GPUInstance SegmentationPanoptic SegmentationSegmentation+1