Real-time 3D Tracking of Articulated Tools for Robotic Surgery
In robotic surgery, tool tracking is important for providing safe tool-tissue interaction and facilitating surgical skills assessment. Despite recent advances in tool tracking, existing approaches are faced with major difficulties in real-time tracking of articulated tools. Most algorithms are tailored for offline processing with pre-recorded videos. In this paper, we propose a real-time 3D tracking method for articulated tools in robotic surgery. The proposed method is based on the CAD model of the tools as well as robot kinematics to generate online part-based templates for efficient 2D matching and 3D pose estimation. A robust verification approach is incorporated to reject outliers in 2D detections, which is then followed by fusing inliers with robot kinematic readings for 3D pose estimation of the tool. The proposed method has been validated with phantom data, as well as ex vivo and in vivo experiments. The results derived clearly demonstrate the performance advantage of the proposed method when compared to the state-of-the-art.
Code (0)
등록된 구현이 없습니다.
Tasks
3D Pose EstimationPose EstimationSkills AssessmentSimilar Papers 제목 키워드 기반
ArtReg: Visuo-Tactile based Pose Tracking and Manipulation of Unseen Articulated Objects
Robots operating in real-world environments frequently encounter unknown objects with complex structures and articulated components, such as doors, drawers, cabinets, and tools. The ability to perceive, track, and manipu…
Point Cloud RegistrationPose TrackingPoint CloudsExploring Category-level Articulated Object Pose Tracking on SE(3) Manifolds
Articulated objects are prevalent in daily life and robotic manipulation tasks. However, compared to rigid objects, pose tracking for articulated objects remains an underexplored problem due to their inherent kinematic c…
Pose TrackingPoint CloudsHierarchical Reinforcement Learning for Articulated Tool Manipulation with Multifingered Hand
Manipulating articulated tools, such as tweezers or scissors, has rarely been explored in previous research. Unlike rigid tools, articulated tools change their shape dynamically, creating unique challenges for dexterous …
Hierarchical Reinforcement LearningPoint CloudsDynamic High Resolution Deformable Articulated Tracking
The last several years have seen significant progress in using depth cameras for tracking articulated objects such as human bodies, hands, and robotic manipulators. Most approaches focus on tracking skeletal parameters o…
GPUPose EstimationVocal Bursts Intensity PredictionReconstructing Articulated Rigged Models from RGB-D Videos
Although commercial and open-source software exist to reconstruct a static object from a sequence recorded with an RGB-D sensor, there is a lack of tools that build rigged models of articulated objects that deform realis…
ClusteringMotion SegmentationObject