SOLO: A Simple Framework for Instance Segmentation
Compared to many other dense prediction tasks, e.g., semantic segmentation, it is the arbitrary number of instances that has made instance segmentation much more challenging. In order to predict a mask for each instance, mainstream approaches either follow the 'detect-then-segment' strategy (e.g., Mask R-CNN), or predict embedding vectors first then cluster pixels into individual instances. In this paper, we view the task of instance segmentation from a completely new perspective by introducing the notion of "instance categories", which assigns categories to each pixel within an instance according to the instance's location. With this notion, we propose segmenting objects by locations (SOLO), a simple, direct, and fast framework for instance segmentation with strong performance. We derive a few SOLO variants (e.g., Vanilla SOLO, Decoupled SOLO, Dynamic SOLO) following the basic principle. Our method directly maps a raw input image to the desired object categories and instance masks, eliminating the need for the grouping post-processing or the bounding box detection. Our approach achieves state-of-the-art results for instance segmentation in terms of both speed and accuracy, while being considerably simpler than the existing methods. Besides instance segmentation, our method yields state-of-the-art results in object detection (from our mask byproduct) and panoptic segmentation. We further demonstrate the flexibility and high-quality segmentation of SOLO by extending it to perform one-stage instance-level image matting. Code is available at: https://git.io/AdelaiDet
Code (0)
등록된 구현이 없습니다.
Tasks
Image MattingInstance Segmentationobject-detectionObject DetectionPanoptic SegmentationSegmentationSemantic SegmentationSimilar Papers 제목 키워드 기반
FreeSOLO: Learning to Segment Objects without Annotations
Instance segmentation is a fundamental vision task that aims to recognize and segment each object in an image. However, it requires costly annotations such as bounding boxes and segmentation masks for learning. In this w…
Instance Segmentationobject-detectionObject DetectionSegmentation+2SOLOv2: Dynamic and Fast Instance Segmentation
In this work, we aim at building a simple, direct, and fast instance segmentation framework with strong performance. We follow the principle of the SOLO method of Wang et al. "SOLO: segmenting objects by locations". Impo…
Instance Segmentationobject-detectionObject DetectionPanoptic Segmentation+4Exemplar-FreeSOLO: Enhancing Unsupervised Instance Segmentation With Exemplars
Instance segmentation seeks to identify and segment each object from images, which often relies on a large number of dense annotations for model training. To alleviate this burden, unsupervised instance segmentation …
Instance SegmentationSegmentationSemantic SegmentationUnsupervised Instance SegmentationSOLO: Segmenting Objects by Locations
We present a new, embarrassingly simple approach to instance segmentation in images. Compared to many other dense prediction tasks, e.g., semantic segmentation, it is the arbitrary number of instances that have made inst…
ClusteringGeneral ClassificationInstance SegmentationSegmentation+1SODAR: Segmenting Objects by DynamicallyAggregating Neighboring Mask Representations
Recent state-of-the-art one-stage instance segmentation model SOLO divides the input image into a grid and directly predicts per grid cell object masks with fully-convolutional networks, yielding comparably good performa…
Instance SegmentationObjectSemantic Segmentation