Real-Time Constrained 6D Object-Pose Tracking of An In-Hand Suture Needle for Minimally Invasive Robotic Surgery
Autonomous suturing has been a long-sought-after goal for surgical robotics. Outside of staged environments, accurate localization of suture needles is a critical foundation for automating various suture needle manipulation tasks in the real world. When localizing a needle held by a gripper, previous work usually tracks them separately without considering their relationship. Because of the significant errors that can arise in the stereo-triangulation of objects and instruments, their reconstructions may often not be consistent. This can lead to unrealistic tool-needle grasp reconstructions that are infeasible. Instead, an obvious strategy to improve localization would be to leverage constraints that arise from contact, thereby constraining reconstructions of objects and instruments into a jointly feasible space. In this work, we consider feasible grasping constraints when tracking the 6D pose of an in-hand suture needle. We propose a reparameterization trick to define a new state space for describing a needle pose, where grasp constraints can be easily defined and satisfied. Our proposed state space and feasible grasping constraints are then incorporated into Bayesian filters for real-time needle localization. In the experiments, we show that our constrained methods outperform previous unconstrained/constrained tracking approaches and demonstrate the importance of incorporating feasible grasping constraints into automating suture needle manipulation tasks.
Code (0)
등록된 구현이 없습니다.
Tasks
Pose TrackingSimilar Papers 제목 키워드 기반
Extending Multi-Object Tracking systems to better exploit appearance and 3D information
Tracking multiple objects in real time is essential for a variety of real-world applications, with self-driving industry being at the foremost. This work involves exploiting temporally varying appearance and motion infor…
Multi-Object TrackingObjectObject TrackingReal-Time Multi-Object TrackingConfidence Trigger Detection: Accelerating Real-time Tracking-by-detection Systems
Real-time object tracking necessitates a delicate balance between speed and accuracy, a challenge exacerbated by the computational demands of deep learning methods. In this paper, we propose Confidence-Triggered Detectio…
Autonomous Drivingobject-detectionObject DetectionObject TrackingDeep Learning-based Lightweight RGB Object Tracking for Augmented Reality Devices
Augmented Reality (AR) applications often require robust real-time tracking of objects in the user's environment to correctly overlay virtual content. Recent advances in computer vision have produced highly accurate deep…
Knowledge DistillationObject TrackingOpen3DTrack: Towards Open-Vocabulary 3D Multi-Object Tracking
3D multi-object tracking plays a critical role in autonomous driving by enabling the real-time monitoring and prediction of multiple objects' movements. Traditional 3D tracking systems are typically constrained by predef…
3D Multi-Object TrackingAutonomous DrivingMulti-Object TrackingObject+1The Unmanned Aerial Vehicle Benchmark: Object Detection and Tracking
With the advantage of high mobility, Unmanned Aerial Vehicles (UAVs) are used to fuel numerous important applications in computer vision, delivering more efficiency and convenience than surveillance cameras with fixed ca…
Multiple Object TrackingObjectobject-detectionObject Detection+2