paper-with-me

홈 › Papers

MOIS-SAM2: Exemplar-based Segment Anything Model 2 for multilesion interactive segmentation of neurofibromas in whole-body MRI

2025-09-23 · Georgii Kolokolnikov, Marie-Lena Schmalhofer, Sophie Goetz, Lennart Well, Said Farschtschi, Victor-Felix Mautner, Inka Ristow, Rene Werner arxiv

Background and Objectives: Neurofibromatosis type 1 is a genetic disorder characterized by the development of numerous neurofibromas (NFs) throughout the body. Whole-body MRI (WB-MRI) is the clinical standard for detection and longitudinal surveillance of NF tumor growth. Existing interactive segmentation methods fail to combine high lesion-wise precision with scalability to hundreds of lesions. This study proposes a novel interactive segmentation model tailored to this challenge. Methods: We introduce MOIS-SAM2, a multi-object interactive segmentation model that extends the state-of-the-art, transformer-based, promptable Segment Anything Model 2 (SAM2) with exemplar-based semantic propagation. MOIS-SAM2 was trained and evaluated on 119 WB-MRI scans from 84 NF1 patients acquired using T2-weighted fat-suppressed sequences. The dataset was split at the patient level into a training set and four test sets (one in-domain and three reflecting different domain shift scenarios, e.g., MRI field strength variation, low tumor burden, differences in clinical site and scanner vendor). Results: On the in-domain test set, MOIS-SAM2 achieved a scan-wise DSC of 0.60 against expert manual annotations, outperforming baseline 3D nnU-Net (DSC: 0.54) and SAM2 (DSC: 0.35). Performance of the proposed model was maintained under MRI field strength shift (DSC: 0.53) and scanner vendor variation (DSC: 0.50), and improved in low tumor burden cases (DSC: 0.61). Lesion detection F1 scores ranged from 0.62 to 0.78 across test sets. Preliminary inter-reader variability analysis showed model-to-expert agreement (DSC: 0.62-0.68), comparable to inter-expert agreement (DSC: 0.57-0.69). Conclusions: The proposed MOIS-SAM2 enables efficient and scalable interactive segmentation of NFs in WB-MRI with minimal user input and strong generalization, supporting integration into clinical workflows.

📄 PDF Abstract BibTeX arXiv:2509.19277

Code (0)

등록된 구현이 없습니다.

Tasks

Interactive Segmentation

Similar Papers 제목 키워드 기반

Track Anything: Segment Anything Meets Videos

2023-04-24 · Jinyu Yang, Mingqi Gao, Zhe Li, Shang Gao 외

Recently, the Segment Anything Model (SAM) gains lots of attention rapidly due to its impressive segmentation performance on images. Regarding its strong ability on image segmentation and high interactivity with differen…

Image SegmentationObject TrackingSegmentationSemantic Segmentation+1

AI-SAM: Automatic and Interactive Segment Anything Model

2023-12-05 · Yimu Pan, Sitao Zhang, Alison D. Gernand, Jeffery A. Goldstein 외

Semantic segmentation is a core task in computer vision. Existing methods are generally divided into two categories: automatic and interactive. Interactive approaches, exemplified by the Segment Anything Model (SAM), hav…

Medical Image SegmentationSemantic Segmentation

Segment Anything for Microscopy

2023-08-22 · bioRxiv 2023 8 · Anwai Archit, Sushmita Nair, Nabeel Khalid, Paul Hilt 외

We present Segment Anything for Microscopy, a tool for interactive and automatic segmentation and tracking of objects in multi-dimensional microscopy data. Our method is based on Segment Anything, a vision foundation mod…

Image SegmentationInstance SegmentationObject TrackingSegmentation+1

SAM 3: Segment Anything with Concepts

2025-11-20 · Nicolas Carion, Laura Gustafson, Yuan-Ting Hu, Shoubhik Debnath 외 arxiv

We present Segment Anything Model (SAM) 3, a unified model that detects, segments, and tracks objects in images and videos based on concept prompts, which we define as either short noun phrases (e.g., "yellow school bus"…

Learning from Exemplars for Interactive Image Segmentation

2024-06-17 · Kun Li, Hao Cheng, George Vosselman, Michael Ying Yang

Interactive image segmentation enables users to interact minimally with a machine, facilitating the gradual refinement of the segmentation mask for a target of interest. Previous studies have demonstrated impressive perf…

Image SegmentationInteractive SegmentationSegmentationSemantic Segmentation