paper-with-me

Papers

Unseen Object Amodal Instance Segmentation via Hierarchical Occlusion Modeling

2021-09-23 · Seunghyeok Back, Joosoon Lee, Taewon Kim, Sangjun Noh, Raeyoung Kang, Seongho Bak, Kyoobin Lee

Instance-aware segmentation of unseen objects is essential for a robotic system in an unstructured environment. Although previous works achieved encouraging results, they were limited to segmenting the only visible regions of unseen objects. For robotic manipulation in a cluttered scene, amodal perception is required to handle the occluded objects behind others. This paper addresses Unseen Object Amodal Instance Segmentation (UOAIS) to detect 1) visible masks, 2) amodal masks, and 3) occlusions on unseen object instances. For this, we propose a Hierarchical Occlusion Modeling (HOM) scheme designed to reason about the occlusion by assigning a hierarchy to a feature fusion and prediction order. We evaluated our method on three benchmarks (tabletop, indoors, and bin environments) and achieved state-of-the-art (SOTA) performance. Robot demos for picking up occluded objects, codes, and datasets are available at https://sites.google.com/view/uoais

📄 PDF Abstract BibTeX arXiv:2109.11103

Code (1)

gist-ailab/uoais 공식 구현 pytorch

Tasks

Amodal Instance SegmentationInstance SegmentationObjectSegmentationSemantic SegmentationUnseen Object Instance Segmentation

Similar Papers 제목 키워드 기반

SynTable: A Synthetic Data Generation Pipeline for Unseen Object Amodal Instance Segmentation of Cluttered Tabletop Scenes

2023-07-14 · Zhili Ng, Haozhe Wang, Zhengshen Zhang, Francis Tay Eng Hock 외

In this work, we present SynTable, a unified and flexible Python-based dataset generator built using NVIDIA's Isaac Sim Replicator Composer for generating high-quality synthetic datasets for unseen object amodal instance…

Amodal Instance SegmentationDataset GenerationInstance SegmentationSemantic Segmentation+1

A2VIS: Amodal-Aware Approach to Video Instance Segmentation

2024-12-02 · Minh Tran, Thang Pham, Winston Bounsavy, Tri Nguyen 외

Handling occlusion remains a significant challenge for video instance-level tasks like Multiple Object Tracking (MOT) and Video Instance Segmentation (VIS). In this paper, we propose a novel framework, Amodal-Aware Video…

Instance SegmentationMultiple Object TrackingObjectObject Tracking+3

Amodal Instance Segmentation

2016-04-27 · Ke Li, Jitendra Malik

We consider the problem of amodal instance segmentation, the objective of which is to predict the region encompassing both visible and occluded parts of each object. Thus far, the lack of publicly available amodal segmen…

Amodal Instance SegmentationInstance SegmentationSegmentationSemantic Segmentation

2D Amodal Instance Segmentation Guided by 3D Shape Prior

2022-06-01 · European Conference on Computer Vision (ECCV) 2022 6 · Zhixuan Li, Weining Ye, Tingting Jiang, Tiejun Huang

Amodal instance segmentation aims to predict the complete mask of the occluded instance, including both visible and invisible regions. Existing 2D AIS methods learn and predict the complete silhouettes of target instance…

3D ReconstructionAmodal Instance SegmentationInstance SegmentationSegmentation+1

Learning to See the Invisible: End-to-End Trainable Amodal Instance Segmentation

2018-04-24 · Patrick Follmann, Rebecca König, Philipp Härtinger, Michael Klostermann

Semantic amodal segmentation is a recently proposed extension to instance-aware segmentation that includes the prediction of the invisible region of each object instance. We present the first all-in-one end-to-end traina…

Amodal Instance SegmentationData AugmentationInstance SegmentationSegmentation+1