paper-with-me

홈 › Papers

ESAD: Endoscopic Surgeon Action Detection Dataset

2020-06-12 · Vivek Singh Bawa, Gurkirt Singh, Francis KapingA, InnaSkarga-Bandurova, Alice Leporini, Carmela Landolfo, Armando Stabile, Francesco Setti, Riccardo Muradore, Elettra Oleari, Fabio Cuzzolin

In this work, we take aim towards increasing the effectiveness of surgical assistant robots. We intended to make assistant robots safer by making them aware about the actions of surgeon, so it can take appropriate assisting actions. In other words, we aim to solve the problem of surgeon action detection in endoscopic videos. To this, we introduce a challenging dataset for surgeon action detection in real-world endoscopic videos. Action classes are picked based on the feedback of surgeons and annotated by medical professional. Given a video frame, we draw bounding box around surgical tool which is performing action and label it with action label. Finally, we presenta frame-level action detection baseline model based on recent advances in ob-ject detection. Results on our new dataset show that our presented dataset provides enough interesting challenges for future method and it can serveas strong benchmark corresponding research in surgeon action detection in endoscopic videos.

📄 PDF Abstract BibTeX arXiv:2006.07164

Code (0)

등록된 구현이 없습니다.

Tasks

Action Detection

Similar Papers 제목 키워드 기반

The SARAS Endoscopic Surgeon Action Detection (ESAD) dataset: Challenges and methods

2021-04-07 · Vivek Singh Bawa, Gurkirt Singh, Francis KapingA, Inna Skarga-Bandurova 외

For an autonomous robotic system, monitoring surgeon actions and assisting the main surgeon during a procedure can be very challenging. The challenges come from the peculiar structure of the surgical scene, the greater s…

Action Detection

Automatic Tip Detection of Surgical Instruments in Biportal Endoscopic Spine Surgery

2019-11-07 · Sue Min Cho, Young-Gon Kim, Jinhoon Jeong, Ho-jin Lee 외

Some endoscopic surgeries require a surgeon to hold the endoscope with one hand and the surgical instruments with the other hand to perform the actual surgery with correct vision. Recent technical advances in deep learni…

Deep Learning

EndoVLA: Dual-Phase Vision-Language-Action Model for Autonomous Tracking in Endoscopy

2025-05-21 · Chi Kit Ng, Long Bai, Guankun Wang, Yupeng Wang 외

In endoscopic procedures, autonomous tracking of abnormal regions and following circumferential cutting markers can significantly reduce the cognitive burden on endoscopists. However, conventional model-based pipelines a…

Motion PlanningVision-Language-ActionZero-shot Generalization

Visual Information Retrieval in Endoscopic Video Archives

2015-04-29 · Jennifer Roldan-Carlos, Mathias Lux, Xavier Giró-i-Nieto, Pia Muñoz 외

In endoscopic procedures, surgeons work with live video streams from the inside of their subjects. A main source for documentation of procedures are still frames from the video, identified and taken during the surgery. H…

Information RetrievalRetrievalVideo Retrieval

SAVAnet: Surgical Action-Driven Visual Attention Network for Autonomous Endoscope Control

2022-09-19 · IEEE Transactions on Automation Science and Engineering 2022 9 · Huxin Gao, Weichen Fan, Liang Qiu, Xiaoxiao Yang 외

An endoscope holder must understand the detailed surgical actions and the surgeons’ visual attention to keep important targets in the field of endoscopic view during operations. From an intensive analysis of the surgeons…