paper-with-me

홈 › Papers

Monocular Microscope to CT Registration using Pose Estimation of the Incus for Augmented Reality Cochlear Implant Surgery

2024-03-12 · Yike Zhang, Eduardo Davalos, Dingjie Su, Ange Lou, Jack H. Noble

For those experiencing severe-to-profound sensorineural hearing loss, the cochlear implant (CI) is the preferred treatment. Augmented reality (AR) aided surgery can potentially improve CI procedures and hearing outcomes. Typically, AR solutions for image-guided surgery rely on optical tracking systems to register pre-operative planning information to the display so that hidden anatomy or other important information can be overlayed and co-registered with the view of the surgical scene. In this paper, our goal is to develop a method that permits direct 2D-to-3D registration of the microscope video to the pre-operative Computed Tomography (CT) scan without the need for external tracking equipment. Our proposed solution involves using surface mapping of a portion of the incus in surgical recordings and determining the pose of this structure relative to the surgical microscope by performing pose estimation via the perspective-n-point (PnP) algorithm. This registration can then be applied to pre-operative segmentations of other anatomy-of-interest, as well as the planned electrode insertion trajectory to co-register this information for the AR display. Our results demonstrate the accuracy with an average rotation error of less than 25 degrees and a translation error of less than 2 mm, 3 mm, and 0.55% for the x, y, and z axes, respectively. Our proposed method has the potential to be applicable and generalized to other surgical procedures while only needing a monocular microscope during intra-operation.

📄 PDF Abstract BibTeX arXiv:2403.07219

Code (0)

등록된 구현이 없습니다.

Tasks

AnatomyComputed Tomography (CT)Pose Estimation

Similar Papers 제목 키워드 기반

Monocular Marker-free Patient-to-Image Intraoperative Registration for Cochlear Implant Surgery

2025-05-23 · Yike Zhang, Eduardo Davalos Anaya, Jack H. Noble

This paper presents a novel method for monocular patient-to-image intraoperative registration, specifically designed to operate without any external hardware tracking equipment or fiducial point markers. Leveraging a syn…

Zero-Shot Learning

Cortical Surface Co-Registration based on MRI Images and Photos

2013-03-22 · Benjamin Berkels, Ivan Cabrilo, Sven Haller, Martin Rumpf 외

Brain shift, i.e. the change in configuration of the brain after opening the dura mater, is a key problem in neuronavigation. We present an approach to co-register intra-operative microscope images with pre-operative MRI…

General ClassificationRobust classification

Learning Expected Appearances for Intraoperative Registration during Neurosurgery

2023-10-03 · Nazim Haouchine, Reuben Dorent, Parikshit Juvekar, Erickson Torio 외

We present a novel method for intraoperative patient-to-image registration by learning Expected Appearances. Our method uses preoperative imaging to synthesize patient-specific expected views through a surgical microscop…

Image Registration

Monocular 3D Human Pose Estimation for Sports Broadcasts using Partial Sports Field Registration

2023-04-10 · Tobias Baumgartner, Stefanie Klatt

The filming of sporting events projects and flattens the movement of athletes in the world onto a 2D broadcast image. The pixel locations of joints in these images can be detected with high validity. Recovering the actua…

2D Human Pose Estimation3D Human Pose Estimation3D Pose EstimationCamera Calibration+3

Automatic Tool Landmark Detection for Stereo Vision in Robot-Assisted Retinal Surgery

2017-09-17 · Thomas Probst, Kevis-Kokitsi Maninis, Ajad Chhatkuli, Mouloud Ourak 외

Computer vision and robotics are being increasingly applied in medical interventions. Especially in interventions where extreme precision is required they could make a difference. One such application is robot-assisted r…

3D ReconstructionAnatomy