OAFormer: Learning Occlusion Distinguishable Feature for Amodal Instance Segmentation
The Amodal Instance Segmentation (AIS) task aims to infer the complete mask of occluded instance. Under many circumstances, existing methods treat occluded objects as unoccluded ones, and vice versa, leading to inaccurate predictions. This is because existing AIS methods do not explicitly utilize the occlusion rates of each object as supervision. However, occlusion information is critical for the methods to recognize whether the target objects are occluded. Hence we believe it is vital for the method to be distinguishable about the degree of occlusion for each instance. In this paper, a simple yet effective Occlusion-aware transformer-based model, OAFormer, is proposed for accurate amodal instance segmentation. The goal of OAFormer is to learn the occlusion discriminative features. Novel components are proposed to enable OAFormer to be occlusion distinguishable. We conduct extensive experiments on two challenging AIS datasets to evaluate the effectiveness of our method. OAFormer outperforms state-of-the-art methods by large margins.
Code (0)
등록된 구현이 없습니다.
Tasks
Amodal Instance SegmentationInstance SegmentationSegmentationSemantic SegmentationSimilar Papers 제목 키워드 기반
Unseen Object Amodal Instance Segmentation via Hierarchical Occlusion Modeling
Instance-aware segmentation of unseen objects is essential for a robotic system in an unstructured environment. Although previous works achieved encouraging results, they were limited to segmenting the only visible regio…
Amodal Instance SegmentationInstance SegmentationObjectSegmentation+2Learning to Generate Multiple Objects from Dense and Occluded Layouts
Text-to-image diffusion models fail to generate correct object counts in dense scenes, where overlapping instances collapse into indistinguishable structures despite appearing visually plausible. We identify this as inst…
Perceiving the Invisible: Proposal-Free Amodal Panoptic Segmentation
Amodal panoptic segmentation aims to connect the perception of the world to its cognitive understanding. It entails simultaneously predicting the semantic labels of visible scene regions and the entire shape of traffic p…
Amodal Panoptic SegmentationDecoderPanoptic SegmentationLearning Vector Quantized Shape Code for Amodal Blastomere Instance Segmentation
Blastomere instance segmentation is important for analyzing embryos' abnormality. To measure the accurate shapes and sizes of blastomeres, their amodal segmentation is necessary. Amodal instance segmentation aims to reco…
Amodal Instance SegmentationInstance SegmentationObjectSegmentation+1Amodal Intra-class Instance Segmentation: Synthetic Datasets and Benchmark
Images of realistic scenes often contain intra-class objects that are heavily occluded from each other, making the amodal perception task that requires parsing the occluded parts of the objects challenging. Although impo…
Amodal Instance SegmentationInstance SegmentationRobotic GraspingSemantic Segmentation