Deep Occlusion-Aware Instance Segmentation with Overlapping BiLayers
Segmenting highly-overlapping objects is challenging, because typically no distinction is made between real object contours and occlusion boundaries. Unlike previous two-stage instance segmentation methods, we model image formation as composition of two overlapping layers, and propose Bilayer Convolutional Network (BCNet), where the top GCN layer detects the occluding objects (occluder) and the bottom GCN layer infers partially occluded instance (occludee). The explicit modeling of occlusion relationship with bilayer structure naturally decouples the boundaries of both the occluding and occluded instances, and considers the interaction between them during mask regression. We validate the efficacy of bilayer decoupling on both one-stage and two-stage object detectors with different backbones and network layer choices. Despite its simplicity, extensive experiments on COCO and KINS show that our occlusion-aware BCNet achieves large and consistent performance gain especially for heavy occlusion cases. Code is available at https://github.com/lkeab/BCNet.
Code (1)
Tasks
Amodal Instance SegmentationBoundary DetectionInstance SegmentationObject DetectionOcclusion HandlingReal-time Instance SegmentationSemantic SegmentationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Occlusion-Aware Instance Segmentation via BiLayer Network Architectures
Segmenting highly-overlapping image objects is challenging, because there is typically no distinction between real object contours and occlusion boundaries on images. Unlike previous instance segmentation methods, we mod…
Human Instance SegmentationInstance SegmentationSegmentationSemantic Segmentation+1Prohibited Items Segmentation via Occlusion-aware Bilayer Modeling
Instance segmentation of prohibited items in security X-ray images is a critical yet challenging task. This is mainly caused by the significant appearance gap between prohibited items in X-ray images and natural objects,…
DecoderImage SegmentationInstance SegmentationOcclusion Estimation+3Leveraging Multi-View Weak Supervision for Occlusion-Aware Multi-Human Parsing
Multi-human parsing is the task of segmenting human body parts while associating each part to the person it belongs to, combining instance-level and part-level information for fine-grained human understanding. In this wo…
Human Instance SegmentationMulti-Human ParsingA Bilayer Segmentation-Recombination Network for Accurate Segmentation of Overlapping C. elegans
Caenorhabditis elegans (C. elegans) is an excellent model organism because of its short lifespan and high degree of homology with human genes, and it has been widely used in a variety of human health and disease models. …
Instance SegmentationSegmentationSemantic SegmentationLearning Instance Occlusion for Panoptic Segmentation
Panoptic segmentation requires segments of both "things" (countable object instances) and "stuff" (uncountable and amorphous regions) within a single output. A common approach involves the fusion of instance segmentation…
Instance SegmentationPanoptic SegmentationRelationSegmentation+1