paper-with-me

홈 › Papers

Investigating a Policy-Based Formulation for Endoscopic Camera Pose Recovery

2026-03-20 · Jan Emily Mangulabnan, Akshat Chauhan, Laura Fleig, Lalithkumar Seenivasan, Roger D. Soberanis-Mukul, S. Swaroop Vedula, Russell H. Taylor, Masaru Ishii, Gregory D. Hager, Mathias Unberath arxiv

In endoscopic surgery, surgeons continuously locate the endoscopic view relative to the anatomy by interpreting the evolving visual appearance of the intraoperative scene in the context of their prior knowledge. Vision-based navigation systems seek to replicate this capability by recovering camera pose directly from endoscopic video, but most approaches do not embody the same principles of reasoning about new frames that makes surgeons successful. Instead, they remain grounded in feature matching and geometric optimization over keyframes, an approach that has been shown to degrade under the challenging conditions of endoscopic imaging like low texture and rapid illumination changes. Here, we pursue an alternative approach and investigate a policy-based formulation of endoscopic camera pose recovery that seeks to imitate experts in estimating trajectories conditioned on the previous camera state. Our approach directly predicts short-horizon relative motions without maintaining an explicit geometric representation at inference time. It thus addresses, by design, some of the notorious challenges of geometry-based approaches, such as brittle correspondence matching, instability in texture-sparse regions, and limited pose coverage due to reconstruction failure. We evaluate the proposed formulation on cadaveric sinus endoscopy. Under oracle state conditioning, we compare short-horizon motion prediction quality to geometric baselines achieving lowest mean translation error and competitive rotational accuracy. We analyze robustness by grouping prediction windows according to texture richness and illumination change indicating reduced sensitivity to low-texture conditions. These findings suggest that a learned motion policy offers a viable alternative formulation for endoscopic camera pose recovery.

📄 PDF Abstract BibTeX arXiv:2603.20045

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

MedGS: Gaussian Splatting for Multi-Modal 3D Medical Imaging

2025-09-20 · Kacper Marzol, Ignacy Kolton, Weronika Smolak-Dyżewska, Joanna Kaleta 외 arxiv

Endoluminal endoscopic procedures are essential for diagnosing colorectal cancer and other severe conditions in the digestive tract, urogenital system, and airways. 3D reconstruction and novel-view synthesis from endosco…

3D Reconstruction

EndoDAC: Efficient Adapting Foundation Model for Self-Supervised Depth Estimation from Any Endoscopic Camera

2024-05-14 · Beilei Cui, Mobarakol Islam, Long Bai, An Wang 외

Depth estimation plays a crucial role in various tasks within endoscopic surgery, including navigation, surface reconstruction, and augmented reality visualization. Despite the significant achievements of foundation mode…

Depth EstimationSurface Reconstruction

FLex: Joint Pose and Dynamic Radiance Fields Optimization for Stereo Endoscopic Videos

2024-03-18 · Florian Philipp Stilz, Mert Asim Karaoglu, Felix Tristram, Nassir Navab 외

Reconstruction of endoscopic scenes is an important asset for various medical applications, from post-surgery analysis to educational training. Neural rendering has recently shown promising results in endoscopic reconstr…

Neural RenderingNovel View Synthesis

EndoGSLAM: Real-Time Dense Reconstruction and Tracking in Endoscopic Surgeries using Gaussian Splatting

2024-03-22 · Kailing Wang, Chen Yang, Yuehao Wang, Sikuang Li 외

Precise camera tracking, high-fidelity 3D tissue reconstruction, and real-time online visualization are critical for intrabody medical imaging devices such as endoscopes and capsule robots. However, existing SLAM (Simult…

Simultaneous Localization and Mapping

BASED: Bundle-Adjusting Surgical Endoscopic Dynamic Video Reconstruction using Neural Radiance Fields

2023-09-27 · Shreya Saha, Zekai Liang, Shan Lin, Jingpei Lu 외

Reconstruction of deformable scenes from endoscopic videos is important for many applications such as intraoperative navigation, surgical visual perception, and robotic surgery. It is a foundational requirement for reali…

NeRFVideo Reconstruction