paper-with-me

Papers

Influence of Prompting Strategies on Segment Anything Model (SAM) for Short-axis Cardiac MRI segmentation

2023-12-14 · Josh Stein, Maxime Di Folco, Julia A. Schnabel

The Segment Anything Model (SAM) has recently emerged as a significant breakthrough in foundation models, demonstrating remarkable zero-shot performance in object segmentation tasks. While SAM is designed for generalization, it exhibits limitations in handling specific medical imaging tasks that require fine-structure segmentation or precise boundaries. In this paper, we focus on the task of cardiac magnetic resonance imaging (cMRI) short-axis view segmentation using the SAM foundation model. We conduct a comprehensive investigation of the impact of different prompting strategies (including bounding boxes, positive points, negative points, and their combinations) on segmentation performance. We evaluate on two public datasets using the baseline model and models fine-tuned with varying amounts of annotated data, ranging from a limited number of volumes to a fully annotated dataset. Our findings indicate that prompting strategies significantly influence segmentation performance. Combining positive points with either bounding boxes or negative points shows substantial benefits, but little to no benefit when combined simultaneously. We further observe that fine-tuning SAM with a few annotated volumes improves segmentation performance when properly prompted. Specifically, fine-tuning with bounding boxes has a positive impact, while fine-tuning without bounding boxes leads to worse results compared to baseline.

📄 PDF Abstract BibTeX arXiv:2312.08932

Code (0)

등록된 구현이 없습니다.

Tasks

MRI segmentationSegmentationSemantic Segmentation

Methods 이 논문이 사용한 방법론

SAM 설명 없음
Focus 설명 없음

Similar Papers 제목 키워드 기반

Benchmarking Human and Automated Prompting in the Segment Anything Model

2024-10-29 · Jorge Quesada, Zoe Fowler, Mohammad Alotaibi, Mohit Prabhushankar 외

The remarkable capabilities of the Segment Anything Model (SAM) for tackling image segmentation tasks in an intuitive and interactive manner has sparked interest in the design of effective visual prompts. Such interest h…

BenchmarkingImage SegmentationSemantic SegmentationVisual Prompting

Segment Anything in 3D with Radiance Fields

2023-04-24 · NeurIPS 2023 11 · Jiazhong Cen, Jiemin Fang, Zanwei Zhou, Chen Yang 외

The Segment Anything Model (SAM) emerges as a powerful vision foundation model to generate high-quality 2D segmentation results. This paper aims to generalize SAM to segment 3D objects. Rather than replicating the data a…

Inverse RenderingSegmentation

Fast Segment Anything

2023-06-21 · Xu Zhao, Wenchao Ding, Yongqi An, Yinglong Du 외

The recently proposed segment anything model (SAM) has made a significant influence in many computer vision tasks. It is becoming a foundation step for many high-level tasks, like image segmentation, image caption, and i…

Edge DetectionImage SegmentationInstance SegmentationObject Proposal Generation+4

From Generalization to Precision: Exploring SAM for Tool Segmentation in Surgical Environments

2024-02-28 · Kanyifeechukwu J. Oguine, Roger D. Soberanis-Mukul, Nathan Drenkow, Mathias Unberath

Purpose: Accurate tool segmentation is essential in computer-aided procedures. However, this task conveys challenges due to artifacts' presence and the limited training data in medical scenarios. Methods that generalize …

SegmentationZero Shot Segmentation

Performance and Non-adversarial Robustness of the Segment Anything Model 2 in Surgical Video Segmentation

2024-08-07 · Yiqing Shen, Hao Ding, Xinyuan Shao, Mathias Unberath

Fully supervised deep learning (DL) models for surgical video segmentation have been shown to struggle with non-adversarial, real-world corruptions of image quality including smoke, bleeding, and low illumination. Founda…

Adversarial RobustnessImage SegmentationInteractive SegmentationNon-Adversarial Robustness+5