ESAD: Endoscopic Surgeon Action Detection Dataset
In this work, we take aim towards increasing the effectiveness of surgical assistant robots. We intended to make assistant robots safer by making them aware about the actions of surgeon, so it can take appropriate assisting actions. In other words, we aim to solve the problem of surgeon action detection in endoscopic videos. To this, we introduce a challenging dataset for surgeon action detection in real-world endoscopic videos. Action classes are picked based on the feedback of surgeons and annotated by medical professional. Given a video frame, we draw bounding box around surgical tool which is performing action and label it with action label. Finally, we presenta frame-level action detection baseline model based on recent advances in ob-ject detection. Results on our new dataset show that our presented dataset provides enough interesting challenges for future method and it can serveas strong benchmark corresponding research in surgeon action detection in endoscopic videos.
Code (0)
등록된 구현이 없습니다.
Tasks
Action DetectionSimilar Papers 제목 키워드 기반
The SARAS Endoscopic Surgeon Action Detection (ESAD) dataset: Challenges and methods
For an autonomous robotic system, monitoring surgeon actions and assisting the main surgeon during a procedure can be very challenging. The challenges come from the peculiar structure of the surgical scene, the greater s…
Action DetectionAutomatic Tip Detection of Surgical Instruments in Biportal Endoscopic Spine Surgery
Some endoscopic surgeries require a surgeon to hold the endoscope with one hand and the surgical instruments with the other hand to perform the actual surgery with correct vision. Recent technical advances in deep learni…
Deep LearningEndoVLA: Dual-Phase Vision-Language-Action Model for Autonomous Tracking in Endoscopy
In endoscopic procedures, autonomous tracking of abnormal regions and following circumferential cutting markers can significantly reduce the cognitive burden on endoscopists. However, conventional model-based pipelines a…
Motion PlanningVision-Language-ActionZero-shot GeneralizationVisual Information Retrieval in Endoscopic Video Archives
In endoscopic procedures, surgeons work with live video streams from the inside of their subjects. A main source for documentation of procedures are still frames from the video, identified and taken during the surgery. H…
Information RetrievalRetrievalVideo RetrievalSAVAnet: Surgical Action-Driven Visual Attention Network for Autonomous Endoscope Control
An endoscope holder must understand the detailed surgical actions and the surgeons’ visual attention to keep important targets in the field of endoscopic view during operations. From an intensive analysis of the surgeons…