Multi-scale Cell Instance Segmentation with Keypoint Graph based Bounding Boxes
Most existing methods handle cell instance segmentation problems directly without relying on additional detection boxes. These methods generally fails to separate touching cells due to the lack of global understanding of the objects. In contrast, box-based instance segmentation solves this problem by combining object detection with segmentation. However, existing methods typically utilize anchor box-based detectors, which would lead to inferior instance segmentation performance due to the class imbalance issue. In this paper, we propose a new box-based cell instance segmentation method. In particular, we first detect the five pre-defined points of a cell via keypoints detection. Then we group these points according to a keypoint graph and subsequently extract the bounding box for each cell. Finally, cell segmentation is performed on feature maps within the bounding boxes. We validate our method on two cell datasets with distinct object shapes, and empirically demonstrate the superiority of our method compared to other instance segmentation techniques. Code is available at: https://github.com/yijingru/KG_Instance_Segmentation.
Code (1)
Tasks
Cell SegmentationInstance Segmentationobject-detectionObject DetectionSegmentationSemantic SegmentationSimilar Papers 제목 키워드 기반
PersonLab: Person Pose Estimation and Instance Segmentation with a Bottom-Up, Part-Based, Geometric Embedding Model
We present a box-free bottom-up approach for the tasks of pose estimation and instance segmentation of people in multi-person images using an efficient single-shot model. The proposed PersonLab model tackles both semanti…
Instance SegmentationKeypoint DetectionMulti-Person Pose EstimationPose Estimation+1Pose2Instance: Harnessing Keypoints for Person Instance Segmentation
Human keypoints are a well-studied representation of people.We explore how to use keypoint models to improve instance-level person segmentation. The main idea is to harness the notion of a distance transform of oracle pr…
Instance SegmentationSegmentationSemantic SegmentationAttend to Who You Are: Supervising Self-Attention for Keypoint Detection and Instance-Aware Association
This paper presents a new method to solve keypoint detection and instance association by using Transformer. For bottom-up multi-person pose estimation models, they need to detect keypoints and learn associative informati…
Instance SegmentationKeypoint DetectionMulti-Person Pose EstimationPose Estimation+1Keypoints as Dynamic Centroids for Unified Human Pose and Segmentation
The dynamic movement of the human body presents a fundamental challenge for human pose estimation and body segmentation. State-of-the-art approaches primarily rely on combining keypoint heatmaps with segmentation masks b…
Keypoint DetectionPose EstimationSegmentationInstance segmentation of buildings using keypoints
Building segmentation is of great importance in the task of remote sensing imagery interpretation. However, the existing semantic segmentation and instance segmentation methods often lead to segmentation masks with blurr…
Instance SegmentationSegmentationSemantic Segmentation