paper-with-me

홈 › Papers

Multitask Learning in Minimally Invasive Surgical Vision: A Review

2024-01-16 · Oluwatosin Alabi, Tom Vercauteren, Miaojing Shi

Minimally invasive surgery (MIS) has revolutionized many procedures and led to reduced recovery time and risk of patient injury. However, MIS poses additional complexity and burden on surgical teams. Data-driven surgical vision algorithms are thought to be key building blocks in the development of future MIS systems with improved autonomy. Recent advancements in machine learning and computer vision have led to successful applications in analyzing videos obtained from MIS with the promise of alleviating challenges in MIS videos. Surgical scene and action understanding encompasses multiple related tasks that, when solved individually, can be memory-intensive, inefficient, and fail to capture task relationships. Multitask learning (MTL), a learning paradigm that leverages information from multiple related tasks to improve performance and aid generalization, is wellsuited for fine-grained and high-level understanding of MIS data. This review provides an overview of the current state-of-the-art MTL systems that leverage videos obtained from MIS. Beyond listing published approaches, we discuss the benefits and limitations of these MTL systems. Moreover, this manuscript presents an analysis of the literature for various application fields of MTL in MIS, including those with large models, highlighting notable trends, new directions of research, and developments.

📄 PDF Abstract BibTeX arXiv:2401.08256

Code (0)

등록된 구현이 없습니다.

Tasks

Action Understanding

Similar Papers 제목 키워드 기반

Methods and datasets for segmentation of minimally invasive surgical instruments in endoscopic images and videos: A review of the state of the art

2023-04-25 · Tobias Rueckert, Daniel Rueckert, Christoph Palm

In the field of computer- and robot-assisted minimally invasive surgery, enormous progress has been made in recent years based on the recognition of surgical instruments in endoscopic images and videos. In particular, th…

ArticlesInstance SegmentationSegmentationSemantic Segmentation

Automatic Detection of Out-of-body Frames in Surgical Videos for Privacy Protection Using Self-supervised Learning and Minimal Labels

2023-03-31 · Ziheng Wang, Conor Perreault, Xi Liu, Anthony Jarc

Endoscopic video recordings are widely used in minimally invasive robot-assisted surgery, but when the endoscope is outside the patient's body, it can capture irrelevant segments that may contain sensitive information. T…

Self-Supervised Learning

Simultaneous Recognition and Pose Estimation of Instruments in Minimally Invasive Surgery

2017-10-18 · Thomas Kurmann, Pablo Marquez Neila, Xiaofei Du, Pascal Fua 외

Detection of surgical instruments plays a key role in ensuring patient safety in minimally invasive surgery. In this paper, we present a novel method for 2D vision-based recognition and pose estimation of surgical instru…

Pose Estimation

PitVis-2023 Challenge: Workflow Recognition in videos of Endoscopic Pituitary Surgery

2024-09-02 · Adrito Das, Danyal Z. Khan, Dimitrios Psychogyios, Yitong Zhang 외

The field of computer vision applied to videos of minimally invasive surgery is ever-growing. Workflow recognition pertains to the automated recognition of various aspects of a surgery: including which surgical steps are…

Instrument Recognition

SurgAtlas: A Large-Scale Surgical Video-Language Dataset with 2,391 Hours of Open and Minimally Invasive Surgery

2026-06-24 · Filippos Bellos, Andre S. Gala-Garza, Miaowei Wang, Alyssa M. Hardin 외 arxiv

We introduce SurgAtlas, the largest surgical video-language dataset to date, comprising 15,291 videos (2,391 hours) spanning 18 surgical specialties and over 5,000 procedure types, sourced entirely from publicly availabl…

Question Answering