ISINet: An Instance-Based Approach for Surgical Instrument Segmentation
We study the task of semantic segmentation of surgical instruments in robotic-assisted surgery scenes. We propose the Instance-based Surgical Instrument Segmentation Network (ISINet), a method that addresses this task from an instance-based segmentation perspective. Our method includes a temporal consistency module that takes into account the previously overlooked and inherent temporal information of the problem. We validate our approach on the existing benchmark for the task, the Endoscopic Vision 2017 Robotic Instrument Segmentation Dataset, and on the 2018 version of the dataset, whose annotations we extended for the fine-grained version of instrument segmentation. Our results show that ISINet significantly outperforms state-of-the-art methods, with our baseline version duplicating the Intersection over Union (IoU) of previous methods and our complete model triplicating the IoU.
Code (1)
Tasks
SegmentationSemantic SegmentationSimilar Papers 제목 키워드 기반
Grounding Surgical Action Triplets with Instrument Instance Segmentation: A Dataset and Target-Aware Fusion Approach
Understanding surgical instrument-tissue interactions requires not only identifying which instrument performs which action on which anatomical target, but also grounding these interactions spatially within the surgical s…
Action Triplet RecognitionInstance SegmentationAction UnderstandingScene UnderstandingSurgPIS: Surgical-instrument-level Instances and Part-level Semantics for Weakly-supervised Part-aware Instance Segmentation
Consistent surgical instrument segmentation is critical for automation in robot-assisted surgery. Yet, existing methods only treat instrument-level instance segmentation (IIS) or part-level semantic segmentation (PSS) se…
Semantic SegmentationInstance SegmentationFrom Forks to Forceps: A New Framework for Instance Segmentation of Surgical Instruments
Minimally invasive surgeries and related applications demand surgical tool classification and segmentation at the instance level. Surgical tools are similar in appearance and are long, thin, and handled at an angle. The …
ARCClassificationInstance SegmentationMetric Learning+2PWISeg: Point-based Weakly-supervised Instance Segmentation for Surgical Instruments
In surgical procedures, correct instrument counting is essential. Instance segmentation is a location method that locates not only an object's bounding box but also each pixel's specific details. However, obtaining mask-…
Instance SegmentationSegmentationSemantic SegmentationSurgical tool detection+2Identifying Surgical Instruments in Laparoscopy Using Deep Learning Instance Segmentation
Recorded videos from surgeries have become an increasingly important information source for the field of medical endoscopy, since the recorded footage shows every single detail of the surgery. However, while video record…
Instrument RecognitionInstance Segmentation