paper-with-me

Papers

SegMatch: A semi-supervised learning method for surgical instrument segmentation

2023-08-09 · Meng Wei, Charlie Budd, Luis C. Garcia-Peraza-Herrera, Reuben Dorent, Miaojing Shi, Tom Vercauteren

Surgical instrument segmentation is recognised as a key enabler to provide advanced surgical assistance and improve computer assisted interventions. In this work, we propose SegMatch, a semi supervised learning method to reduce the need for expensive annotation for laparoscopic and robotic surgical images. SegMatch builds on FixMatch, a widespread semi supervised classification pipeline combining consistency regularization and pseudo labelling, and adapts it for the purpose of segmentation. In our proposed SegMatch, the unlabelled images are weakly augmented and fed into the segmentation model to generate a pseudo-label to enforce the unsupervised loss against the output of the model for the adversarial augmented image on the pixels with a high confidence score. Our adaptation for segmentation tasks includes carefully considering the equivariance and invariance properties of the augmentation functions we rely on. To increase the relevance of our augmentations, we depart from using only handcrafted augmentations and introduce a trainable adversarial augmentation strategy. Our algorithm was evaluated on the MICCAI Instrument Segmentation Challenge datasets Robust-MIS 2019 and EndoVis 2017. Our results demonstrate that adding unlabelled data for training purposes allows us to surpass the performance of fully supervised approaches which are limited by the availability of training data in these challenges. SegMatch also outperforms a range of state-of-the-art semi-supervised learning semantic segmentation models in different labelled to unlabelled data ratios.

📄 PDF Abstract BibTeX arXiv:2308.05232

Code (0)

등록된 구현이 없습니다.

Tasks

Medical Image SegmentationPseudo LabelSegmentationSemantic Segmentation

Methods 이 논문이 사용한 방법론

FixMatch FixMatch is an algorithm that first generates pseudo-labels using the model's predictions on weakly-augmented unlabeled images. For a given image, the pseudo-label is only…

Similar Papers 제목 키워드 기반

Learning Motion Flows for Semi-supervised Instrument Segmentation from Robotic Surgical Video

2020-07-06 · Zixu Zhao, Yueming Jin, Xiaojie Gao, Qi Dou 외

Performing low hertz labeling for surgical videos at intervals can greatly releases the burden of surgeons. In this paper, we study the semi-supervised instrument segmentation from robotic surgical videos with sparse ann…

Segmentation

FUN-SIS: a Fully UNsupervised approach for Surgical Instrument Segmentation

2022-02-16 · Luca Sestini, Benoit Rosa, Elena De Momi, Giancarlo Ferrigno 외

Automatic surgical instrument segmentation of endoscopic images is a crucial building block of many computer-assistance applications for minimally invasive surgery. So far, state-of-the-art approaches completely rely on …

Optical Flow EstimationSegmentation

PWISeg: Point-based Weakly-supervised Instance Segmentation for Surgical Instruments

2023-11-16 · Zhen Sun, Huan Xu, Jinlin Wu, Zhen Chen 외

In surgical procedures, correct instrument counting is essential. Instance segmentation is a location method that locates not only an object's bounding box but also each pixel's specific details. However, obtaining mask-…

Instance SegmentationSegmentationSemantic SegmentationSurgical tool detection+2

Unsupervised Surgical Instrument Segmentation via Anchor Generation and Semantic Diffusion

2020-08-27 · Daochang Liu, Yuhui Wei, Tingting Jiang, Yizhou Wang 외

Surgical instrument segmentation is a key component in developing context-aware operating rooms. Existing works on this task heavily rely on the supervision of a large amount of labeled data, which involve laborious and …

Feature CorrelationSegmentation

Self-Supervised Surgical Instrument 3D Reconstruction from a Single Camera Image

2022-11-26 · Ange Lou, Xing Yao, Ziteng Liu, Jintong Han 외

Surgical instrument tracking is an active research area that can provide surgeons feedback about the location of their tools relative to anatomy. Recent tracking methods are mainly divided into two parts: segmentation an…

3D ReconstructionAnatomyAttributeobject-detection+3