paper-with-me

Papers

Parameter-Efficient Adaptation of SAM3 for Prompt-Driven Surgical Concept Segmentation

2026-07-26 · Changjing Liu, Yiming Huang, Beilei Cui, Liangjing Shao, Long Bai, Yanheng Li, Haoxuan Che, Hongliang Ren arxiv

Efficient surgical segmentation empowers clinical diagnosis, intraoperative monitoring, and downstream robotic pipelines for reconstruction and simulation. Although prompt-driven foundation models like Segment Anything Model 3 (SAM3) achieve strong segmentation performance on natural images, surgical data exhibits domain gaps against its pre-training data, resulting in degraded segmentation accuracy. Furthermore, existing medical SAM methods require full-parameter fine-tuning, incurring heavy computational consumption and low efficiency. To address these limitations, this work proposes a parameter-efficient Low-Rank Adaptation (LoRA) adaptation of SAM3 for surgical concept segmentation. We inject low-rank adapters into the prompt encoder, detector and tracker while fully freezing the vision backbone, which only optimizes 0.98% of the total model parameters and supports training on a single consumer GPU. Comprehensive experiments demonstrate that our method consistently outperforms zero-shot SAM3 and other mainstream baselines, and the generated segmentation results can be directly deployed to support downstream robotic surgical scene reconstruction and physical simulation pipelines.

📄 PDF Abstract BibTeX arXiv:2607.23694

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Text-driven Adaptation of Foundation Models for Few-shot Surgical Workflow Analysis

2025-01-16 · Tingxuan Chen, Kun Yuan, Vinkle Srivastav, Nassir Navab 외

Purpose: Surgical workflow analysis is crucial for improving surgical efficiency and safety. However, previous studies rely heavily on large-scale annotated datasets, posing challenges in cost, scalability, and reliance …

DecoderImage CaptioningTriplet

SurgicalVLM-Agent: Towards an Interactive AI Co-Pilot for Pituitary Surgery

2025-03-12 · Jiayuan Huang, Runlong He, Danyal Z. Khan, Evangelos Mazomenos 외

Image-guided surgery demands adaptive, real-time decision support, yet static AI models struggle with structured task planning and providing interactive guidance. Large vision-language models (VLMs) offer a promising sol…

Activity RecognitionAnatomyQuestion AnsweringSegmentation+4

Federated Learning for Surgical Vision in Appendicitis Classification: Results of the FedSurg EndoVis 2024 Challenge

2025-10-06 · Max Kirchner, Hanna Hoffmann, Alexander C. Jenke, Oliver L. Saldanha 외 arxiv

Developing generalizable surgical AI requires multi-institutional data, yet patient privacy constraints preclude direct data sharing, making Federated Learning (FL) a natural candidate solution. The application of FL to …

parameter-efficient fine-tuningFederated Learning

Medical SAM3: A Foundation Model for Universal Prompt-Driven Medical Image Segmentation

2026-01-15 · Chongcong Jiang, Tianxingjian Ding, Chuhan Song, Jiachen Tu 외 arxiv

Promptable segmentation foundation models such as SAM3 have demonstrated strong generalization capabilities through interactive and concept-based prompting. However, their direct applicability to medical image segmentati…

Medical Image SegmentationPrompt Engineering

Recognizing Surgical Phases Anywhere: Few-Shot Test-time Adaptation and Task-graph Guided Refinement

2025-06-25 · Kun Yuan, Tingxuan Chen, Shi Li, Joel L. Lavanchy 외

The complexity and diversity of surgical workflows, driven by heterogeneous operating room settings, institutional protocols, and anatomical variability, present a significant challenge in developing generalizable models…

Surgical phase recognitionTest-time Adaptation