paper-with-me

홈 › Papers

DARIL: When Imitation Learning outperforms Reinforcement Learning in Surgical Action Planning

2025-07-07 · Maxence Boels, Harry Robertshaw, Thomas C Booth, Prokar Dasgupta, Alejandro Granados, Sebastien Ourselin arxiv

Surgical action planning requires predicting future instrument-verb-target triplets for real-time assistance. While teleoperated robotic surgery provides natural expert demonstrations for imitation learning (IL), reinforcement learning (RL) could potentially discover superior strategies through self-exploration. We present the first comprehensive comparison of IL versus RL for surgical action planning on CholecT50. Our Dual-task Autoregressive Imitation Learning (DARIL) baseline achieves 34.6% action triplet recognition mAP and 33.6% next frame prediction mAP with smooth planning degradation to 29.2% at 10-second horizons. We evaluated three RL variants: world model-based RL, direct video RL, and inverse RL enhancement. Surprisingly, all RL approaches underperformed DARIL--world model RL dropped to 3.1% mAP at 10s while direct video RL achieved only 15.9%. Our analysis reveals that distribution matching on expert-annotated test sets systematically favors IL over potentially valid RL policies that differ from training demonstrations. This challenges assumptions about RL superiority in sequential decision making and provides crucial insights for surgical AI development.

📄 PDF Abstract BibTeX arXiv:2507.05011

Code (0)

등록된 구현이 없습니다.

Tasks

Action Triplet RecognitionReinforcement LearningDecision Making

Similar Papers 제목 키워드 기반

SurgIRL: Towards Life-Long Learning for Surgical Automation by Incremental Reinforcement Learning

2024-09-24 · Yun-Jie Ho, Zih-Yun Chiu, Yuheng Zhi, Michael C. Yip

Surgical automation holds immense potential to improve the outcome and accessibility of surgery. Recent studies use reinforcement learning to learn policies that automate different surgical tasks. However, these policies…

Incremental Learningreinforcement-learningReinforcement Learning

Toward a Surgeon-in-the-Loop Ophthalmic Robotic Apprentice using Reinforcement and Imitation Learning

2023-11-29 · Amr Gomaa, Bilal Mahdy, Niko Kleer, Antonio Krüger

Robot-assisted surgical systems have demonstrated significant potential in enhancing surgical precision and minimizing human errors. However, existing systems cannot accommodate individual surgeons' unique preferences an…

Imitation Learning

Surgical Instruction Generation with Transformers

2021-07-14 · Jinglu Zhang, Yinyu Nie, Jian Chang, Jian Jun Zhang

Automatic surgical instruction generation is a prerequisite towards intra-operative context-aware surgical assistance. However, generating instructions from surgical scenes is challenging, as it requires jointly understa…

DecoderMachine TranslationReinforcement Learning (RL)Translation

Reward Learning from Suboptimal Demonstrations with Applications in Surgical Electrocautery

2024-04-10 · Zohre Karimi, Shing-Hei Ho, Bao Thach, Alan Kuntz 외

Automating robotic surgery via learning from demonstration (LfD) techniques is extremely challenging. This is because surgical tasks often involve sequential decision-making processes with complex interactions of physica…

Decision MakingImitation LearningReinforcement Learning (RL)Sequential Decision Making

Surgical Temporal Action-aware Network with Sequence Regularization for Phase Recognition

2023-11-21 · Zhen Chen, Yuhao Zhai, Jun Zhang, Jinqiao Wang

To assist surgeons in the operating theatre, surgical phase recognition is critical for developing computer-assisted surgical systems, which requires comprehensive understanding of surgical videos. Although existing stud…

Surgical phase recognition