Unseen Object Amodal Instance Segmentation via Hierarchical Occlusion Modeling
Instance-aware segmentation of unseen objects is essential for a robotic system in an unstructured environment. Although previous works achieved encouraging results, they were limited to segmenting the only visible regions of unseen objects. For robotic manipulation in a cluttered scene, amodal perception is required to handle the occluded objects behind others. This paper addresses Unseen Object Amodal Instance Segmentation (UOAIS) to detect 1) visible masks, 2) amodal masks, and 3) occlusions on unseen object instances. For this, we propose a Hierarchical Occlusion Modeling (HOM) scheme designed to reason about the occlusion by assigning a hierarchy to a feature fusion and prediction order. We evaluated our method on three benchmarks (tabletop, indoors, and bin environments) and achieved state-of-the-art (SOTA) performance. Robot demos for picking up occluded objects, codes, and datasets are available at https://sites.google.com/view/uoais
Code (1)
Tasks
Amodal Instance SegmentationInstance SegmentationObjectSegmentationSemantic SegmentationUnseen Object Instance SegmentationSimilar Papers 제목 키워드 기반
SynTable: A Synthetic Data Generation Pipeline for Unseen Object Amodal Instance Segmentation of Cluttered Tabletop Scenes
In this work, we present SynTable, a unified and flexible Python-based dataset generator built using NVIDIA's Isaac Sim Replicator Composer for generating high-quality synthetic datasets for unseen object amodal instance…
Amodal Instance SegmentationDataset GenerationInstance SegmentationSemantic Segmentation+1A2VIS: Amodal-Aware Approach to Video Instance Segmentation
Handling occlusion remains a significant challenge for video instance-level tasks like Multiple Object Tracking (MOT) and Video Instance Segmentation (VIS). In this paper, we propose a novel framework, Amodal-Aware Video…
Instance SegmentationMultiple Object TrackingObjectObject Tracking+3Amodal Instance Segmentation
We consider the problem of amodal instance segmentation, the objective of which is to predict the region encompassing both visible and occluded parts of each object. Thus far, the lack of publicly available amodal segmen…
Amodal Instance SegmentationInstance SegmentationSegmentationSemantic Segmentation2D Amodal Instance Segmentation Guided by 3D Shape Prior
Amodal instance segmentation aims to predict the complete mask of the occluded instance, including both visible and invisible regions. Existing 2D AIS methods learn and predict the complete silhouettes of target instance…
3D ReconstructionAmodal Instance SegmentationInstance SegmentationSegmentation+1Learning to See the Invisible: End-to-End Trainable Amodal Instance Segmentation
Semantic amodal segmentation is a recently proposed extension to instance-aware segmentation that includes the prediction of the invisible region of each object instance. We present the first all-in-one end-to-end traina…
Amodal Instance SegmentationData AugmentationInstance SegmentationSegmentation+1