YOLACT: Real-time Instance Segmentation
We present a simple, fully-convolutional model for real-time instance segmentation that achieves 29.8 mAP on MS COCO at 33.5 fps evaluated on a single Titan Xp, which is significantly faster than any previous competitive approach. Moreover, we obtain this result after training on only one GPU. We accomplish this by breaking instance segmentation into two parallel subtasks: (1) generating a set of prototype masks and (2) predicting per-instance mask coefficients. Then we produce instance masks by linearly combining the prototypes with the mask coefficients. We find that because this process doesn't depend on repooling, this approach produces very high-quality masks and exhibits temporal stability for free. Furthermore, we analyze the emergent behavior of our prototypes and show they learn to localize instances on their own in a translation variant manner, despite being fully-convolutional. Finally, we also propose Fast NMS, a drop-in 12 ms faster replacement for standard NMS that only has a marginal performance penalty.
Code (48)
Tasks
GPUInstance SegmentationReal-time Instance SegmentationSegmentationSemantic SegmentationTranslationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
YolactEdge: Real-time Instance Segmentation on the Edge
We propose YolactEdge, the first competitive instance segmentation approach that runs on small edge devices at real-time speeds. Specifically, YolactEdge runs at up to 30.8 FPS on a Jetson AGX Xavier (and 172.7 FPS on an…
Instance SegmentationReal-time Instance SegmentationSemantic SegmentationGeneralized Mask-aware IoU for Anchor Assignment for Real-time Instance Segmentation
This paper introduces Generalized Mask-aware Intersection-over-Union (GmaIoU) as a new measure for positive-negative assignment of anchor boxes during training of instance segmentation methods. Unlike conventional IoU me…
Instance SegmentationReal-time Instance SegmentationSegmentationSemantic SegmentationMask-aware IoU for Anchor Assignment in Real-time Instance Segmentation
This paper presents Mask-aware Intersection-over-Union (maIoU) for assigning anchor boxes as positives and negatives during training of instance segmentation methods. Unlike conventional IoU or its variants, which only c…
Instance SegmentationReal-time Instance SegmentationSegmentationSemantic SegmentationAssessing YOLACT++ for real time and robust instance segmentation of medical instruments in endoscopic procedures
Image-based tracking of laparoscopic instruments plays a fundamental role in computer and robotic-assisted surgeries by aiding surgeons and increasing patient safety. Computer vision contests, such as the Robust Medical …
Instance SegmentationReal-time Instance SegmentationSegmentationSemantic SegmentationAutomotive Parts Assessment: Applying Real-time Instance-Segmentation Models to Identify Vehicle Parts
The problem of automated car damage assessment presents a major challenge in the auto repair and damage assessment industry. The domain has several application areas ranging from car assessment companies such as car rent…
Instance Segmentationobject-detectionObject DetectionReal-time Instance Segmentation+2