Deep Snake for Real-Time Instance Segmentation
This paper introduces a novel contour-based approach named deep snake for real-time instance segmentation. Unlike some recent methods that directly regress the coordinates of the object boundary points from an image, deep snake uses a neural network to iteratively deform an initial contour to match the object boundary, which implements the classic idea of snake algorithms with a learning-based approach. For structured feature learning on the contour, we propose to use circular convolution in deep snake, which better exploits the cycle-graph structure of a contour compared against generic graph convolution. Based on deep snake, we develop a two-stage pipeline for instance segmentation: initial contour proposal and contour deformation, which can handle errors in object localization. Experiments show that the proposed approach achieves competitive performances on the Cityscapes, KINS, SBD and COCO datasets while being efficient for real-time applications with a speed of 32.3 fps for 512$\times$512 images on a 1080Ti GPU. The code is available at https://github.com/zju3dv/snake/.
Code (1)
Tasks
GPUInstance SegmentationObjectObject LocalizationReal-time Instance SegmentationSemantic Contour PredictionSemantic SegmentationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Recurrent Generic Contour-based Instance Segmentation with Progressive Learning
Contour-based instance segmentation has been actively studied, thanks to its flexibility and elegance in processing visual objects within complex backgrounds. In this work, we propose a novel deep network architecture, i…
Instance SegmentationLane DetectionObjectScene Text Detection+4BoxSnake: Polygonal Instance Segmentation with Box Supervision
Box-supervised instance segmentation has gained much attention as it requires only simple box annotations instead of costly mask or polygon annotations. However, existing box-supervised instance segmentation models mainl…
Box-supervised Instance SegmentationInstance SegmentationSegmentationSemantic SegmentationCircleSnake: Instance Segmentation with Circle Representation
Circle representation has recently been introduced as a medical imaging optimized representation for more effective instance object detection on ball-shaped medical objects. With its superior performance on instance dete…
Instance Segmentationobject-detectionObject DetectionSegmentation+1Circle Representation for Medical Instance Object Segmentation
Recently, circle representation has been introduced for medical imaging, designed specifically to enhance the detection of instance objects that are spherically shaped (e.g., cells, glomeruli, and nuclei). Given its outs…
Instance SegmentationObjectSegmentationSemantic SegmentationEosinophils Instance Object Segmentation on Whole Slide Imaging Using Multi-label Circle Representation
Eosinophilic esophagitis (EoE) is a chronic and relapsing disease characterized by esophageal inflammation. Symptoms of EoE include difficulty swallowing, food impaction, and chest pain which significantly impact the qua…
Cell SegmentationDiagnosticInstance SegmentationSegmentation+1