paper-with-me

홈 › Papers

Open-Source Multi-Viewpoint Surgical Telerobotics

2025-05-16 · Guido Caccianiga, Yarden Sharon, Bernard Javot, Senya Polikovsky, Gökce Ergün, Ivan Capobianco, André L. Mihaljevic, Anton Deguet, Katherine J. Kuchenbecker

As robots for minimally invasive surgery (MIS) gradually become more accessible and modular, we believe there is a great opportunity to rethink and expand the visualization and control paradigms that have characterized surgical teleoperation since its inception. We conjecture that introducing one or more additional adjustable viewpoints in the abdominal cavity would not only unlock novel visualization and collaboration strategies for surgeons but also substantially boost the robustness of machine perception toward shared autonomy. Immediate advantages include controlling a second viewpoint and teleoperating surgical tools from a different perspective, which would allow collaborating surgeons to adjust their views independently and still maneuver their robotic instruments intuitively. Furthermore, we believe that capturing synchronized multi-view 3D measurements of the patient's anatomy would unlock advanced scene representations. Accurate real-time intraoperative 3D perception will allow algorithmic assistants to directly control one or more robotic instruments and/or robotic cameras. Toward these goals, we are building a synchronized multi-viewpoint, multi-sensor robotic surgery system by integrating high-performance vision components and upgrading the da Vinci Research Kit control logic. This short paper reports a functional summary of our setup and elaborates on its potential impacts in research and future clinical practice. By fully open-sourcing our system, we will enable the research community to reproduce our setup, improve it, and develop powerful algorithms, effectively boosting clinical translation of cutting-edge research.

📄 PDF Abstract BibTeX arXiv:2505.11142

Code (0)

등록된 구현이 없습니다.

Tasks

Anatomy

Similar Papers 제목 키워드 기반

TSP-OCS: A Time-Series Prediction for Optimal Camera Selection in Multi-Viewpoint Surgical Video Analysis

2025-04-09 · Xinyu Liu, Xiaoguang Lin, Xiang Liu, Yong Yang 외

Recording the open surgery process is essential for educational and medical evaluation purposes; however, traditional single-camera methods often face challenges such as occlusions caused by the surgeon's head and body, …

PredictionTime SeriesTime Series Prediction

Multimodal Semantic Scene Graphs for Holistic Modeling of Surgical Procedures

2021-06-09 · Ege Özsoy, Evin Pınar Örnek, Ulrich Eck, Federico Tombari 외

From a computer science viewpoint, a surgical domain model needs to be a conceptual one incorporating both behavior and data. It should therefore model actors, devices, tools, their complex interactions and data flow. To…

SurgVIL: Scaling Surgical Robot Imitation Learning with Open-source Surgical Videos

2026-08-17 · Xinhao Chen, JuoTung Chen, Nigel Nelson, Antony Goldenberg 외 arxiv

Learning-based surgical robot autonomy requires large-scale demonstrations with synchronized videos and robot actions, but such data are exceedingly rare in clinical or realistic tissue settings because robot kinematics …

Acquiring Submillimeter-Accurate Multi-Task Vision Datasets for Computer-Assisted Orthopedic Surgery

2025-01-26 · Emma Most, Jonas Hein, Frédéric Giraud, Nicola A. Cavalcanti 외

Advances in computer vision, particularly in optical image-based 3D reconstruction and feature matching, enable applications like marker-less surgical navigation and digitization of surgery. However, their development is…

3D Reconstruction

GP-VLS: A general-purpose vision language model for surgery

2024-07-27 · Samuel Schmidgall, Joseph Cho, Cyril Zakka, William Hiesinger

Surgery requires comprehensive medical knowledge, visual assessment skills, and procedural expertise. While recent surgical AI models have focused on solving task-specific problems, there is a need for general-purpose sy…

Language ModelingLanguage ModellingScene Understanding