Part-aware Panoptic Segmentation
In this work, we introduce the new scene understanding task of Part-aware Panoptic Segmentation (PPS), which aims to understand a scene at multiple levels of abstraction, and unifies the tasks of scene parsing and part parsing. For this novel task, we provide consistent annotations on two commonly used datasets: Cityscapes and Pascal VOC. Moreover, we present a single metric to evaluate PPS, called Part-aware Panoptic Quality (PartPQ). For this new task, using the metric and annotations, we set multiple baselines by merging results of existing state-of-the-art methods for panoptic segmentation and part segmentation. Finally, we conduct several experiments that evaluate the importance of the different levels of abstraction in this single task.
Code (1)
Tasks
Image SegmentationPanoptic SegmentationPart-aware Panoptic SegmentationScene ParsingScene UnderstandingSegmentationSimilar Papers 제목 키워드 기반
Uncertainty-aware Panoptic Segmentation
Reliable scene understanding is indispensable for modern autonomous systems. Current learning-based methods typically try to maximize their performance based on segmentation metrics that only consider the quality of the …
Panoptic SegmentationScene UnderstandingSegmentationUncertainty-Aware Panoptic SegmentationJPPF: Multi-task Fusion for Consistent Panoptic-Part Segmentation
Part-aware panoptic segmentation is a problem of computer vision that aims to provide a semantic understanding of the scene at multiple levels of granularity. More precisely, semantic areas, object instances, and semanti…
Panoptic SegmentationPart-aware Panoptic SegmentationRepresentation LearningUncertainty-aware LiDAR Panoptic Segmentation
Modern autonomous systems often rely on LiDAR scanners, in particular for autonomous driving scenarios. In this context, reliable scene understanding is indispensable. Current learning-based methods typically try to achi…
Autonomous DrivingPanoptic SegmentationScene UnderstandingSegmentation+1Task-aligned Part-aware Panoptic Segmentation through Joint Object-Part Representations
Part-aware panoptic segmentation (PPS) requires (a) that each foreground object and background region in an image is segmented and classified, and (b) that all parts within foreground objects are segmented, classified an…
Panoptic SegmentationPart-aware Panoptic SegmentationMonoDVPS: A Self-Supervised Monocular Depth Estimation Approach to Depth-aware Video Panoptic Segmentation
Depth-aware video panoptic segmentation tackles the inverse projection problem of restoring panoptic 3D point clouds from video sequences, where the 3D points are augmented with semantic classes and temporally consistent…
Depth-aware Video Panoptic SegmentationDepth EstimationDepth PredictionImage Segmentation+5