Recurrent Generic Contour-based Instance Segmentation with Progressive Learning
Contour-based instance segmentation has been actively studied, thanks to its flexibility and elegance in processing visual objects within complex backgrounds. In this work, we propose a novel deep network architecture, i.e., PolySnake, for generic contour-based instance segmentation. Motivated by the classic Snake algorithm, the proposed PolySnake achieves superior and robust segmentation performance with an iterative and progressive contour refinement strategy. Technically, PolySnake introduces a recurrent update operator to estimate the object contour iteratively. It maintains a single estimate of the contour that is progressively deformed toward the object boundary. At each iteration, PolySnake builds a semantic-rich representation for the current contour and feeds it to the recurrent operator for further contour adjustment. Through the iterative refinements, the contour progressively converges to a stable status that tightly encloses the object instance. Beyond the scope of general instance segmentation, extensive experiments are conducted to validate the effectiveness and generalizability of our PolySnake in two additional specific task scenarios, including scene text detection and lane detection. The results demonstrate that the proposed PolySnake outperforms the existing advanced methods on several multiple prevalent benchmarks across the three tasks. The codes and pre-trained models are available at https://github.com/fh2019ustc/PolySnake
Code (1)
Tasks
Instance SegmentationLane DetectionObjectScene Text DetectionSegmentationSemantic Contour PredictionSemantic SegmentationText DetectionSimilar Papers 제목 키워드 기반
SharpContour: A Contour-based Boundary Refinement Approach for Efficient and Accurate Instance Segmentation
Excellent performance has been achieved on instance segmentation but the quality on the boundary area remains unsatisfactory, which leads to a rising attention on boundary refinement. For practical use, an ideal post-pro…
Instance SegmentationSegmentationSemantic SegmentationContourFormer:Real-Time Contour-Based End-to-End Instance Segmentation Transformer
This paper presents Contourformer, a real-time contour-based instance segmentation algorithm. The method is fully based on the DETR paradigm and achieves end-to-end inference through iterative and progressive mechanisms …
Instance SegmentationSegmentationSemantic SegmentationContourRender: Detecting Arbitrary Contour Shape For Instance Segmentation In One Pass
Direct contour regression for instance segmentation is a challenging task. Previous works usually achieve it by learning to progressively refine the contour prediction or adopting a shape representation with limited expr…
Instance SegmentationSemantic SegmentationDeep Snake for Real-Time Instance Segmentation
This paper introduces a novel contour-based approach named deep snake for real-time instance segmentation. Unlike some recent methods that directly regress the coordinates of the object boundary points from an image, dee…
GPUInstance SegmentationObjectObject Localization+3Applying Eigencontours to PolarMask-Based Instance Segmentation
Eigencontours are the first data-driven contour descriptors based on singular value decomposition. Based on the implementation of ESE-Seg, eigencontours were applied to the instance segmentation task successfully. In thi…
Instance SegmentationSegmentationSemantic Segmentation