SegVol: Universal and Interactive Volumetric Medical Image Segmentation
Precise image segmentation provides clinical study with instructive information. Despite the remarkable progress achieved in medical image segmentation, there is still an absence of a 3D foundation segmentation model that can segment a wide range of anatomical categories with easy user interaction. In this paper, we propose a 3D foundation segmentation model, named SegVol, supporting universal and interactive volumetric medical image segmentation. By scaling up training data to 90K unlabeled Computed Tomography (CT) volumes and 6K labeled CT volumes, this foundation model supports the segmentation of over 200 anatomical categories using semantic and spatial prompts. To facilitate efficient and precise inference on volumetric images, we design a zoom-out-zoom-in mechanism. Extensive experiments on 22 anatomical segmentation tasks verify that SegVol outperforms the competitors in 19 tasks, with improvements up to 37.24% compared to the runner-up methods. We demonstrate the effectiveness and importance of specific designs by ablation study. We expect this foundation model can promote the development of volumetric medical image analysis. The model and code are publicly available at: https://github.com/BAAI-DCAI/SegVol.
Code (1)
Tasks
Computed Tomography (CT)Image SegmentationMedical Image AnalysisMedical Image SegmentationSegmentationSemantic SegmentationVolumetric Medical Image SegmentationSimilar Papers 제목 키워드 기반
RAPS-3D: Efficient interactive segmentation for 3D radiological imaging
Promptable segmentation, introduced by the Segment Anything Model (SAM), is a promising approach for medical imaging, as it enables clinicians to guide and refine model predictions interactively. However, SAM's architect…
Interactive SegmentationManagementENSAM: an efficient foundation model for interactive segmentation of 3D medical images
We present ENSAM (Equivariant, Normalized, Segment Anything Model), a lightweight and promptable model for universal 3D medical image segmentation. ENSAM combines a SegResNet-based encoder with a prompt encoder and mask …
Medical Image SegmentationInteractive SegmentationTAGS: 3D Tumor-Adaptive Guidance for SAM
Foundation models (FMs) such as CLIP and SAM have recently shown great promise in image segmentation tasks, yet their adaptation to 3D medical imaging-particularly for pathology detection and segmentation-remains underex…
AnatomyImage SegmentationInteractive SegmentationMedical Image Segmentation+3SAM-Med3D-MoE: Towards a Non-Forgetting Segment Anything Model via Mixture of Experts for 3D Medical Image Segmentation
Volumetric medical image segmentation is pivotal in enhancing disease diagnosis, treatment planning, and advancing medical research. While existing volumetric foundation models for medical image segmentation, such as SAM…
General KnowledgeImage SegmentationMedical Image AnalysisMedical Image Segmentation+3Zero-Shot Gaze-based Volumetric Medical Image Segmentation
Accurate segmentation of anatomical structures in volumetric medical images is crucial for clinical applications, including disease monitoring and cancer treatment planning. Contemporary interactive segmentation models, …
Image SegmentationInteractive SegmentationMedical Image SegmentationSegmentation+2