Instance Segmentation of Visible and Occluded Regions for Finding and Picking Target from a Pile of Objects
We present a robotic system for picking a target from a pile of objects that is capable of finding and grasping the target object by removing obstacles in the appropriate order. The fundamental idea is to segment instances with both visible and occluded masks, which we call instance occlusion segmentation'. To achieve this, we extend an existing instance segmentation model with a novel relook' architecture, in which the model explicitly learns the inter-instance relationship. Also, by using image synthesis, we make the system capable of handling new objects without human annotations. The experimental results show the effectiveness of the relook architecture when compared with a conventional model and of the image synthesis when compared to a human-annotated dataset. We also demonstrate the capability of our system to achieve picking a target in a cluttered environment with a real robot.
Code (0)
등록된 구현이 없습니다.
Tasks
Image GenerationInstance SegmentationSegmentationSemantic SegmentationSimilar Papers 제목 키워드 기반
Learnable Shape Prototypes with Occlusion-Geometry-Guided Injection for Amodal Instance Segmentation
Amodal instance segmentation aims to predict the complete object mask including occluded regions that lack pixel-level observations and must be inferred with the aid of shape priors. Existing methods acquire shape priors…
Amodal Instance SegmentationUnseen Object Amodal Instance Segmentation via Hierarchical Occlusion Modeling
Instance-aware segmentation of unseen objects is essential for a robotic system in an unstructured environment. Although previous works achieved encouraging results, they were limited to segmenting the only visible regio…
Amodal Instance SegmentationInstance SegmentationObjectSegmentation+22D Amodal Instance Segmentation Guided by 3D Shape Prior
Amodal instance segmentation aims to predict the complete mask of the occluded instance, including both visible and invisible regions. Existing 2D AIS methods learn and predict the complete silhouettes of target instance…
3D ReconstructionAmodal Instance SegmentationInstance SegmentationSegmentation+1BLADE: Box-Level Supervised Amodal Segmentation through Directed Expansion
Perceiving the complete shape of occluded objects is essential for human and machine intelligence. While the amodal segmentation task is to predict the complete mask of partially occluded objects, it is time-consuming an…
Amodal Instance SegmentationSegmentationPerceiving the Invisible: Proposal-Free Amodal Panoptic Segmentation
Amodal panoptic segmentation aims to connect the perception of the world to its cognitive understanding. It entails simultaneously predicting the semantic labels of visible scene regions and the entire shape of traffic p…
Amodal Panoptic SegmentationDecoderPanoptic Segmentation