Real-time Instance Segmentation with Discriminative Orientation Maps
Although instance segmentation has made considerable advancement over recent years, it's still a challenge to design high accuracy algorithms with real-time performance. In this paper, we propose a real-time instance segmentation framework termed OrienMask. Upon the one-stage object detector YOLOv3, a mask head is added to predict some discriminative orientation maps, which are explicitly defined as spatial offset vectors for both foreground and background pixels. Thanks to the discrimination ability of orientation maps, masks can be recovered without the need for extra foreground segmentation. All instances that match with the same anchor size share a common orientation map. This special sharing strategy reduces the amortized memory utilization for mask predictions but without loss of mask granularity. Given the surviving box predictions after NMS, instance masks can be concurrently constructed from the corresponding orientation maps with low complexity. Owing to the concise design for mask representation and its effective integration with the anchor-based object detector, our method is qualified under real-time conditions while maintaining competitive accuracy. Experiments on COCO benchmark show that OrienMask achieves 34.8 mask AP at the speed of 42.7 fps evaluated with a single RTX 2080 Ti. The code is available at https://github.com/duwt/OrienMask.
Code (1)
Tasks
Foreground SegmentationInstance SegmentationReal-time Instance SegmentationSegmentationSemantic SegmentationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Efficient Multi-Task RGB-D Scene Analysis for Indoor Environments
Semantic scene understanding is essential for mobile agents acting in various environments. Although semantic segmentation already provides a lot of information, details about individual objects as well as the general sc…
Instance SegmentationPanoptic SegmentationScene ClassificationScene Classification (unified classes)+3A Deep Learning Approach to Teeth Segmentation and Orientation from Panoramic X-rays
Accurate teeth segmentation and orientation are fundamental in modern oral healthcare, enabling precise diagnosis, treatment planning, and dental implant design. In this study, we present a comprehensive approach to teet…
Instance SegmentationSegmentationSemantic SegmentationShip Detection in Remote Sensing Imagery for Arbitrarily Oriented Object Detection
This research paper presents an innovative ship detection system tailored for applications like maritime surveillance and ecological monitoring. The study employs YOLOv8 and repurposed U-Net, two advanced deep learning m…
Disaster ResponseInstance Segmentationobject-detectionObject Detection+2Large-scale 6D Object Pose Estimation Dataset for Industrial Bin-Picking
In this paper, we introduce a new public dataset for 6D object pose estimation and instance segmentation for industrial bin-picking. The dataset comprises both synthetic and real-world scenes. For both, point clouds, dep…
6D Pose Estimation using RGBInstance SegmentationObjectPose Estimation+3Incremental Few-Shot Instance Segmentation
Few-shot instance segmentation methods are promising when labeled training data for novel classes is scarce. However, current approaches do not facilitate flexible addition of novel classes. They also require that exampl…
Few-shot Instance SegmentationInstance SegmentationSegmentationSemantic Segmentation