EfficientPPS: Part-aware Panoptic Segmentation of Transparent Objects for Robotic Manipulation
The use of autonomous robots for assistance tasks in hospitals has the potential to free up qualified staff and im-prove patient care. However, the ubiquity of deformable and transparent objects in hospital settings poses signif-icant challenges to vision-based perception systems. We present EfficientPPS, a neural architecture for part-aware panoptic segmentation that provides robots with semantically rich visual information for grasping and ma-nipulation tasks. We also present an unsupervised data collection and labelling method to reduce the need for human involvement in the training process. EfficientPPS is evaluated on a dataset containing real-world hospital objects and demonstrated to be robust and efficient in grasping transparent transfusion bags with a collaborative robot arm.
Code (0)
등록된 구현이 없습니다.
Tasks
Panoptic SegmentationPart-aware Panoptic SegmentationTransparent objectsSimilar Papers 제목 키워드 기반
Part-aware Panoptic Segmentation
In this work, we introduce the new scene understanding task of Part-aware Panoptic Segmentation (PPS), which aims to understand a scene at multiple levels of abstraction, and unifies the tasks of scene parsing and part p…
Image SegmentationPanoptic SegmentationPart-aware Panoptic SegmentationScene Parsing+2Uncertainty-aware Panoptic Segmentation
Reliable scene understanding is indispensable for modern autonomous systems. Current learning-based methods typically try to maximize their performance based on segmentation metrics that only consider the quality of the …
Panoptic SegmentationScene UnderstandingSegmentationUncertainty-Aware Panoptic SegmentationJPPF: Multi-task Fusion for Consistent Panoptic-Part Segmentation
Part-aware panoptic segmentation is a problem of computer vision that aims to provide a semantic understanding of the scene at multiple levels of granularity. More precisely, semantic areas, object instances, and semanti…
Panoptic SegmentationPart-aware Panoptic SegmentationRepresentation LearningUncertainty-aware LiDAR Panoptic Segmentation
Modern autonomous systems often rely on LiDAR scanners, in particular for autonomous driving scenarios. In this context, reliable scene understanding is indispensable. Current learning-based methods typically try to achi…
Autonomous DrivingPanoptic SegmentationScene UnderstandingSegmentation+1Task-aligned Part-aware Panoptic Segmentation through Joint Object-Part Representations
Part-aware panoptic segmentation (PPS) requires (a) that each foreground object and background region in an image is segmented and classified, and (b) that all parts within foreground objects are segmented, classified an…
Panoptic SegmentationPart-aware Panoptic Segmentation