Learning Instance Occlusion for Panoptic Segmentation
Panoptic segmentation requires segments of both "things" (countable object instances) and "stuff" (uncountable and amorphous regions) within a single output. A common approach involves the fusion of instance segmentation (for "things") and semantic segmentation (for "stuff") into a non-overlapping placement of segments, and resolves overlaps. However, instance ordering with detection confidence do not correlate well with natural occlusion relationship. To resolve this issue, we propose a branch that is tasked with modeling how two instance masks should overlap one another as a binary relation. Our method, named OCFusion, is lightweight but particularly effective in the instance fusion process. OCFusion is trained with the ground truth relation derived automatically from the existing dataset annotations. We obtain state-of-the-art results on COCO and show competitive results on the Cityscapes panoptic segmentation benchmark.
Code (1)
Tasks
Instance SegmentationPanoptic SegmentationRelationSegmentationSemantic SegmentationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
BANet: Bidirectional Aggregation Network with Occlusion Handling for Panoptic Segmentation
Panoptic segmentation aims to perform instance segmentation for foreground instances and semantic segmentation for background stuff simultaneously. The typical top-down pipeline concentrates on two key issues: 1) how to …
Instance SegmentationOcclusion HandlingPanoptic SegmentationSegmentation+1Panoptic-PolarNet: Proposal-free LiDAR Point Cloud Panoptic Segmentation
Panoptic segmentation presents a new challenge in exploiting the merits of both detection and segmentation, with the aim of unifying instance segmentation and semantic segmentation in a single framework. However, an effi…
ClusteringInstance SegmentationPanoptic SegmentationSegmentation+1Hybrid Tracker with Pixel and Instance for Video Panoptic Segmentation
Video Panoptic Segmentation (VPS) aims to generate coherent panoptic segmentation and track the identities of all pixels across video frames. Existing methods predominantly utilize the trained instance embedding to keep …
Optical Flow EstimationPanoptic SegmentationSegmentationVideo Panoptic SegmentationAn End-to-End Network for Panoptic Segmentation
Panoptic segmentation, which needs to assign a category label to each pixel and segment each object instance simultaneously, is a challenging topic. Traditionally, the existing approaches utilize two independent models w…
Panoptic SegmentationSegmentationPerceiving the Invisible: Proposal-Free Amodal Panoptic Segmentation
Amodal panoptic segmentation aims to connect the perception of the world to its cognitive understanding. It entails simultaneously predicting the semantic labels of visible scene regions and the entire shape of traffic p…
Amodal Panoptic SegmentationDecoderPanoptic Segmentation