PWISeg: Point-based Weakly-supervised Instance Segmentation for Surgical Instruments
In surgical procedures, correct instrument counting is essential. Instance segmentation is a location method that locates not only an object's bounding box but also each pixel's specific details. However, obtaining mask-level annotations is labor-intensive in instance segmentation. To address this issue, we propose a novel yet effective weakly-supervised surgical instrument instance segmentation approach, named Point-based Weakly-supervised Instance Segmentation (PWISeg). PWISeg adopts an FCN-based architecture with point-to-box and point-to-mask branches to model the relationships between feature points and bounding boxes, as well as feature points and segmentation masks on FPN, accomplishing instrument detection and segmentation jointly in a single model. Since mask level annotations are hard to available in the real world, for point-to-mask training, we introduce an unsupervised projection loss, utilizing the projected relation between predicted masks and bboxes as supervision signal. On the other hand, we annotate a few pixels as the key pixel for each instrument. Based on this, we further propose a key pixel association loss and a key pixel distribution loss, driving the point-to-mask branch to generate more accurate segmentation predictions. To comprehensively evaluate this task, we unveil a novel surgical instrument dataset with manual annotations, setting up a benchmark for further research. Our comprehensive research trial validated the superior performance of our PWISeg. The results show that the accuracy of surgical instrument segmentation is improved, surpassing most methods of instance segmentation via weakly supervised bounding boxes. This improvement is consistently observed in our proposed dataset and when applied to the public HOSPI-Tools dataset.
Code (1)
Tasks
Instance SegmentationSegmentationSemantic SegmentationSurgical tool detectionWeakly-supervised instance segmentationWeakly supervised segmentationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Learning Inter-Superpoint Affinity for Weakly Supervised 3D Instance Segmentation
Due to the few annotated labels of 3D point clouds, how to learn discriminative features of point clouds to segment object instances is a challenging problem. In this paper, we propose a simple yet effective 3D instance …
3D Instance SegmentationInstance SegmentationSegmentationSemantic SegmentationClickSeg: 3D Instance Segmentation with Click-Level Weak Annotations
3D instance segmentation methods often require fully-annotated dense labels for training, which are costly to obtain. In this paper, we present ClickSeg, a novel click-level weakly supervised 3D instance segmentation met…
3D Instance SegmentationClusteringInstance SegmentationSegmentation+2SegGroup: Seg-Level Supervision for 3D Instance and Semantic Segmentation
Most existing point cloud instance and semantic segmentation methods rely heavily on strong supervision signals, which require point-level labels for every point in the scene. However, such strong supervision suffers fro…
3D Instance Segmentation3D Semantic SegmentationSegmentationDBGroup: Dual-Branch Point Grouping for Weakly Supervised 3D Semantic Instance Segmentation
Weakly supervised 3D instance segmentation is essential for 3D scene understanding, especially as the growing scale of data and high annotation costs associated with fully supervised approaches. Existing methods primaril…
3D Semantic Instance Segmentation3D Semantic Segmentation3D Instance SegmentationScene UnderstandingBox2Mask: Weakly Supervised 3D Semantic Instance Segmentation Using Bounding Boxes
Current 3D segmentation methods heavily rely on large-scale point-cloud datasets, which are notoriously laborious to annotate. Few attempts have been made to circumvent the need for dense per-point annotations. In this w…
3D Instance Segmentation3D Semantic Instance SegmentationInstance SegmentationSegmentation+1