paper-with-me

홈 › Papers

TAGS: 3D Tumor-Adaptive Guidance for SAM

2025-05-21 · Sirui Li, Linkai Peng, Zheyuan Zhang, Gorkem Durak, Ulas Bagci

Foundation models (FMs) such as CLIP and SAM have recently shown great promise in image segmentation tasks, yet their adaptation to 3D medical imaging-particularly for pathology detection and segmentation-remains underexplored. A critical challenge arises from the domain gap between natural images and medical volumes: existing FMs, pre-trained on 2D data, struggle to capture 3D anatomical context, limiting their utility in clinical applications like tumor segmentation. To address this, we propose an adaptation framework called TAGS: Tumor Adaptive Guidance for SAM, which unlocks 2D FMs for 3D medical tasks through multi-prompt fusion. By preserving most of the pre-trained weights, our approach enhances SAM's spatial feature extraction using CLIP's semantic insights and anatomy-specific prompts. Extensive experiments on three open-source tumor segmentation datasets prove that our model surpasses the state-of-the-art medical image segmentation models (+46.88% over nnUNet), interactive segmentation frameworks, and other established medical FMs, including SAM-Med2D, SAM-Med3D, SegVol, Universal, 3D-Adapter, and SAM-B (at least +13% over them). This highlights the robustness and adaptability of our proposed framework across diverse medical segmentation tasks.

📄 PDF Abstract BibTeX arXiv:2505.17096

Code (0)

등록된 구현이 없습니다.

Tasks

AnatomyImage SegmentationInteractive SegmentationMedical Image SegmentationSegmentationSemantic SegmentationTumor Segmentation

Methods 이 논문이 사용한 방법론

CLIP Contrastive Language-Image Pre-training (CLIP), consisting of a simplified version of ConVIRT trained from scratch, is an efficient method of image representation learning…
SAM 설명 없음

Similar Papers 제목 키워드 기반

UPMAD-Net: A Brain Tumor Segmentation Network with Uncertainty Guidance and Adaptive Multimodal Feature Fusion

2025-05-06 · Zhanyuan Jia, Ni Yao, Danyang Sun, Chuang Han 외

Background: Brain tumor segmentation has a significant impact on the diagnosis and treatment of brain tumors. Accurate brain tumor segmentation remains challenging due to their irregular shapes, vague boundaries, and hig…

Brain Tumor SegmentationBraTS2021SegmentationTumor Segmentation

Decoupled Pyramid Correlation Network for Liver Tumor Segmentation from CT images

2022-05-26 · Yao Zhang, Jiawei Yang, Yang Liu, Jiang Tian 외

Purpose: Automated liver tumor segmentation from Computed Tomography (CT) images is a necessary prerequisite in the interventions of hepatic abnormalities and surgery planning. However, accurate liver tumor segmentation …

Computed Tomography (CT)Image SegmentationLiver SegmentationMedical Image Segmentation+3

Touching the tumor boundary: A pilot study on ultrasound based virtual fixtures for breast-conserving surgery

2025-10-01 · Laura Connolly, Tamas Ungi, Adnan Munawar, Anton Deguet 외 arxiv

Purpose: Delineating tumor boundaries during breast-conserving surgery is challenging as tumors are often highly mobile, non-palpable, and have irregularly shaped borders. To address these challenges, we introduce a coop…

Guiding the Guidance: A Comparative Analysis of User Guidance Signals for Interactive Segmentation of Volumetric Images

2023-03-13 · Zdravko Marinov, Rainer Stiefelhagen, Jens Kleesiek

Interactive segmentation reduces the annotation time of medical images and allows annotators to iteratively refine labels with corrective interactions, such as clicks. While existing interactive models transform clicks i…

AnatomyInteractive SegmentationSegmentation

Synergistic Modality-and-Slice Memory Framework for Cross-Modal 3D Brain Tumor Segmentation

2025-10-12 · Yuxiang Luo, Qing Xu, Hai Huang, Yuqi Ouyang 외 arxiv

The 3D multi-modal brain tumor segmentation is critical to multi-modal healthcare, and it requires accurate identification of distinct internal anatomical subregions. While the recent prompt-based segmentation paradigms …

Brain Tumor Segmentation