MBAPose: Mask and Bounding-Box Aware Pose Estimation of Surgical Instruments with Photorealistic Domain Randomization
Surgical robots are usually controlled using a priori models based on the robots' geometric parameters, which are calibrated before the surgical procedure. One of the challenges in using robots in real surgical settings is that those parameters can change over time, consequently deteriorating control accuracy. In this context, our group has been investigating online calibration strategies without added sensors. In one step toward that goal, we have developed an algorithm to estimate the pose of the instruments' shafts in endoscopic images. In this study, we build upon that earlier work and propose a new framework to more precisely estimate the pose of a rigid surgical instrument. Our strategy is based on a novel pose estimation model called MBAPose and the use of synthetic training data. Our experiments demonstrated an improvement of 21 % for translation error and 26 % for orientation error on synthetic test data with respect to our previous work. Results with real test data provide a baseline for further research.
Code (0)
등록된 구현이 없습니다.
Tasks
3D Pose Estimation6D Pose Estimation using RGBPose EstimationTranslationSimilar Papers 제목 키워드 기반
C-MambaPose: A Physics-Informed Complex Mamba Framework for Cross-Environment WiFi Human Pose Estimation
Human pose estimation (HPE) utilizing wireless WiFi signals has emerged as a promising technology owing to its device-free nature, privacy preservation, and robustness against occlusion and poor lighting. However, existi…
Pose EstimationFGR: Frustum-Aware Geometric Reasoning for Weakly Supervised 3D Vehicle Detection
In this paper, we investigate the problem of weakly supervised 3D vehicle detection. Conventional methods for 3D object detection need vast amounts of manually labelled 3D data as supervision signals. However, annotating…
3D Object Detectionobject-detectionObject Detectionvehicle detectionDetection, Pose Estimation and Segmentation for Multiple Bodies: Closing the Virtuous Circle
Human pose estimation methods work well on separated people but struggle with multi-body scenarios. Recent work has addressed this problem by conditioning pose estimation with detected bounding boxes or bottom-up-estimat…
Human Instance SegmentationPose-Based Human Instance SegmentationPose EstimationSegmentationVSRD: Instance-Aware Volumetric Silhouette Rendering for Weakly Supervised 3D Object Detection
Monocular 3D object detection poses a significant challenge in 3D scene understanding due to its inherently ill-posed nature in monocular depth estimation. Existing methods heavily rely on supervised learning using abund…
3D Object DetectionDepth EstimationMonocular 3D Object DetectionMonocular Depth Estimation+5Bottom-up Object Detection by Grouping Extreme and Center Points
With the advent of deep learning, object detection drifted from a bottom-up to a top-down recognition problem. State of the art algorithms enumerate a near-exhaustive list of object locations and classify each into: obje…
Keypoint EstimationObjectobject-detectionObject Detection