Identifying Surgical Instruments in Laparoscopy Using Deep Learning Instance Segmentation
Recorded videos from surgeries have become an increasingly important information source for the field of medical endoscopy, since the recorded footage shows every single detail of the surgery. However, while video recording is straightforward these days, automatic content indexing - the basis for content-based search in a medical video archive - is still a great challenge due to the very special video content. In this work, we investigate segmentation and recognition of surgical instruments in videos recorded from laparoscopic gynecology. More precisely, we evaluate the achievable performance of segmenting surgical instruments from their background by using a region-based fully convolutional network for instance-aware (1) instrument segmentation as well as (2) instrument recognition. While the first part addresses only binary segmentation of instances (i.e., distinguishing between instrument or background) we also investigate multi-class instrument recognition (i.e., identifying the type of instrument). Our evaluation results show that even with a moderately low number of training examples, we are able to localize and segment instrument regions with a pretty high accuracy. However, the results also reveal that determining the particular instrument is still very challenging, due to the inherently high similarity of surgical instruments.
Code (0)
등록된 구현이 없습니다.
Tasks
Instrument RecognitionInstance SegmentationSimilar Papers 제목 키워드 기반
Exploring Deep Learning Methods for Real-Time Surgical Instrument Segmentation in Laparoscopy
Minimally invasive surgery is a surgical intervention used to examine the organs inside the abdomen and has been widely used due to its effectiveness over open surgery. Due to the hardware improvements such as high defin…
DecoderMedical Image SegmentationSegmentationGLENDA: Gynecologic Laparoscopy Endometriosis Dataset
Gynecologic laparoscopy as a type of minimally invasive surgery (MIS) is performed via a live feed of a patient's abdomen surveying the insertion and handling of various instruments for conducting treatment. Adopting thi…
Exploring Optical Flow Inclusion into nnU-Net Framework for Surgical Instrument Segmentation
Surgical instrument segmentation in laparoscopy is essential for computer-assisted surgical systems. Despite the Deep Learning progress in recent years, the dynamic setting of laparoscopic surgery still presents challeng…
Optical Flow EstimationSegmentationSemantic SegmentationAmodal Segmentation for Laparoscopic Surgery Video Instruments
Segmentation of surgical instruments is crucial for enhancing surgeon performance and ensuring patient safety. Conventional techniques such as binary, semantic, and instance segmentation share a common drawback: they do …
Instance SegmentationSegmentationSemantic SegmentationFrom Forks to Forceps: A New Framework for Instance Segmentation of Surgical Instruments
Minimally invasive surgeries and related applications demand surgical tool classification and segmentation at the instance level. Surgical tools are similar in appearance and are long, thin, and handled at an angle. The …
ARCClassificationInstance SegmentationMetric Learning+2