Robust Surgical Tool Tracking with Pixel-based Probabilities for Projected Geometric Primitives
Controlling robotic manipulators via visual feedback requires a known coordinate frame transformation between the robot and the camera. Uncertainties in mechanical systems as well as camera calibration create errors in this coordinate frame transformation. These errors result in poor localization of robotic manipulators and create a significant challenge for applications that rely on precise interactions between manipulators and the environment. In this work, we estimate the camera-to-base transform and joint angle measurement errors for surgical robotic tools using an image based insertion-shaft detection algorithm and probabilistic models. We apply our proposed approach in both a structured environment as well as an unstructured environment and measure to demonstrate the efficacy of our methods.
Code (0)
등록된 구현이 없습니다.
Tasks
Camera CalibrationSimilar Papers 제목 키워드 기반
Video-based Surgical Tool-tip and Keypoint Tracking using Multi-frame Context-driven Deep Learning Models
Automated tracking of surgical tool keypoints in robotic surgery videos is an essential task for various downstream use cases such as skill assessment, expertise assessment, and the delineation of safety zones. In recent…
Deep LearningKeypoint DetectionPWISeg: Point-based Weakly-supervised Instance Segmentation for Surgical Instruments
In surgical procedures, correct instrument counting is essential. Instance segmentation is a location method that locates not only an object's bounding box but also each pixel's specific details. However, obtaining mask-…
Instance SegmentationSegmentationSemantic SegmentationSurgical tool detection+2Weakly Supervised Convolutional LSTM Approach for Tool Tracking in Laparoscopic Videos
Purpose: Real-time surgical tool tracking is a core component of the future intelligent operating room (OR), because it is highly instrumental to analyze and understand the surgical activities. Current methods for surgic…
Instrument RecognitionObject DetectionSurgical tool detectionVideo Object Tracking+1Control Modes of Teleoperated Surgical Robotic System's Tools in Ophthalmic Surgery
The introduction of a teleoperated surgical robotic system designed for minimally invasive procedures enables the emulation of two distinct control modes through a dedicated input device of the surgical console: (1) Insi…
CholecTrack20: A Multi-Perspective Tracking Dataset for Surgical Tools
Tool tracking in surgical videos is essential for advancing computer-assisted interventions, such as skill assessment, safety zone estimation, and human-machine collaboration. However, the lack of context-rich datase…
Benchmarking