Single-Shot Pose Estimation of Surgical Robot Instruments' Shafts from Monocular Endoscopic Images
Surgical robots are used to perform minimally invasive surgery and alleviate much of the burden imposed on surgeons. Our group has developed a surgical robot to aid in the removal of tumors at the base of the skull via access through the nostrils. To avoid injuring the patients, a collision-avoidance algorithm that depends on having an accurate model for the poses of the instruments' shafts is used. Given that the model's parameters can change over time owing to interactions between instruments and other disturbances, the online estimation of the poses of the instrument's shaft is essential. In this work, we propose a new method to estimate the pose of the surgical instruments' shafts using a monocular endoscope. Our method is based on the use of an automatically annotated training dataset and an improved pose-estimation deep-learning architecture. In preliminary experiments, we show that our method can surpass state of the art vision-based marker-less pose estimation techniques (providing an error decrease of 55% in position estimation, 64% in pitch, and 69% in yaw) by using artificial images.
Code (0)
등록된 구현이 없습니다.
Tasks
Collision AvoidancePose EstimationSimilar Papers 제목 키워드 기반
SurgPose: Generalisable Surgical Instrument Pose Estimation using Zero-Shot Learning and Stereo Vision
Accurate pose estimation of surgical tools in Robot-assisted Minimally Invasive Surgery (RMIS) is essential for surgical navigation and robot control. While traditional marker-based methods offer accuracy, they face chal…
Depth EstimationInstance SegmentationPose EstimationSemantic Segmentation+1SurgRIPE challenge: Benchmark of Surgical Robot Instrument Pose Estimation
Accurate instrument pose estimation is a crucial step towards the future of robotic surgery, enabling applications such as autonomous surgical task execution. Vision-based methods for surgical instrument pose estimation …
Pose EstimationSurgical-DINO: Adapter Learning of Foundation Models for Depth Estimation in Endoscopic Surgery
Purpose: Depth estimation in robotic surgery is vital in 3D reconstruction, surgical navigation and augmented reality visualization. Although the foundation model exhibits outstanding performance in many vision tasks, in…
3D ReconstructionDepth EstimationToward Zero-Shot Learning for Visual Dehazing of Urological Surgical Robots
Robot-assisted surgery has profoundly influenced current forms of minimally invasive surgery. However, in transurethral suburethral urological surgical robots, they need to work in a liquid environment. This causes vapor…
Zero-Shot LearningEfficient Surgical Robotic Instrument Pose Reconstruction in Real World Conditions Using Unified Feature Detection
Accurate camera-to-robot calibration is essential for any vision-based robotic control system and especially critical in minimally invasive surgical robots, where instruments conduct precise micro-manipulations. However,…
Pose Estimation