paper-with-me

홈 › Papers

Deformable Registration Framework for Augmented Reality-based Surgical Guidance in Head and Neck Tumor Resection

2025-03-11 · Qingyun Yang, Fangjie Li, Jiayi Xu, Zixuan Liu, Sindhura Sridhar, Whitney Jin, Jennifer Du, Jon Heiselman, Michael Miga, Michael Topf, Jie Ying Wu

Head and neck squamous cell carcinoma (HNSCC) has one of the highest rates of recurrence cases among solid malignancies. Recurrence rates can be reduced by improving positive margins localization. Frozen section analysis (FSA) of resected specimens is the gold standard for intraoperative margin assessment. However, because of the complex 3D anatomy and the significant shrinkage of resected specimens, accurate margin relocation from specimen back onto the resection site based on FSA results remains challenging. We propose a novel deformable registration framework that uses both the pre-resection upper surface and the post-resection site of the specimen to incorporate thickness information into the registration process. The proposed method significantly improves target registration error (TRE), demonstrating enhanced adaptability to thicker specimens. In tongue specimens, the proposed framework improved TRE by up to 33% as compared to prior deformable registration. Notably, tongue specimens exhibit complex 3D anatomies and hold the highest clinical significance compared to other head and neck specimens from the buccal and skin. We analyzed distinct deformation behaviors in different specimens, highlighting the need for tailored deformation strategies. To further aid intraoperative visualization, we also integrated this framework with an augmented reality-based auto-alignment system. The combined system can accurately and automatically overlay the deformed 3D specimen mesh with positive margin annotation onto the resection site. With a pilot study of the AR guided framework involving two surgeons, the integrated system improved the surgeons' average target relocation error from 9.8 cm to 4.8 cm.

📄 PDF Abstract BibTeX arXiv:2503.08802

Code (0)

등록된 구현이 없습니다.

Tasks

Anatomy

Similar Papers 제목 키워드 기반

Depth Augmented and FE Free 3D/2D Liver Registration for Laparoscopic Liver AR

2026-02-19 · Hanyuan Zhang, Lucas He, Runlong He, Weixi Yi 외 arxiv

Augmented reality (AR) guidance in laparoscopic liver surgery requires accurate registration of preoperative 3D models to intraoperative 2D video, but remains challenging due to partial visibility, specularities, and tis…

Automatic registration with continuous pose updates for marker-less surgical navigation in spine surgery

2023-08-05 · Florentin Liebmann, Marco von Atzigen, Dominik Stütz, Julian Wolf 외

Established surgical navigation systems for pedicle screw placement have been proven to be accurate, but still reveal limitations in registration or surgical guidance. Registration of preoperative data to the intraoperat…

AnatomyGPU

SurgNavAR: An Augmented Reality Surgical Navigation Framework for Optical See-Through Head Mounted Displays

2026-03-31 · Abdullah Thabit, Mohamed Benmahdjoub, Rafiuddin Jinabade, Hizirwan S. Salim 외 arxiv

Augmented reality (AR) devices with head mounted displays (HMDs) facilitate the direct superimposition of 3D preoperative imaging data onto the patient during surgery. To use an HMD-AR device as a stand-alone surgical na…

Warm-Started Reinforcement Learning for Iterative 3D/2D Liver Registration

2026-04-11 · Hanyuan Zhang, Lucas He, Zijie Cheng, Abdolrahim Kadkhodamohammadi 외 arxiv

Registration between preoperative CT and intraoperative laparoscopic video plays a crucial role in augmented reality (AR) guidance for minimally invasive surgery. Learning-based methods have recently achieved registratio…

Reinforcement LearningPose Estimation

EasyREG: Easy Depth-Based Markerless Registration and Tracking using Augmented Reality Device for Surgical Guidance

2025-04-13 · Yue Yang, Christoph Leuze, Brian Hargreaves, Bruce Daniel 외

The use of Augmented Reality (AR) devices for surgical guidance has gained increasing traction in the medical field. Traditional registration methods often rely on external fiducial markers to achieve high accuracy and r…

AnatomyPose Estimation