Zero-shot Domain Generalization of Foundational Models for 3D Medical Image Segmentation: An Experimental Study
Domain shift, caused by variations in imaging modalities and acquisition protocols, limits model generalization in medical image segmentation. While foundation models (FMs) trained on diverse large-scale data hold promise for zero-shot generalization, their application to volumetric medical data remains underexplored. In this study, we examine their ability towards domain generalization (DG), by conducting a comprehensive experimental study encompassing 6 medical segmentation FMs and 12 public datasets spanning multiple modalities and anatomies. Our findings reveal the potential of promptable FMs in bridging the domain gap via smart prompting techniques. Additionally, by probing into multiple facets of zero-shot DG, we offer valuable insights into the viability of FMs for DG and identify promising avenues for future research.
Code (0)
등록된 구현이 없습니다.
Tasks
Domain GeneralizationImage SegmentationMedical Image SegmentationSegmentationSemantic SegmentationZero-shot GeneralizationSimilar Papers 제목 키워드 기반
Cheap Lunch for Medical Image Segmentation by Fine-tuning SAM on Few Exemplars
The Segment Anything Model (SAM) has demonstrated remarkable capabilities of scaled-up segmentation models, enabling zero-shot generalization across a variety of domains. By leveraging large-scale foundational models as …
Brain Tumor SegmentationImage SegmentationMedical Image SegmentationSegmentation+3TV-SAM: Increasing Zero-Shot Segmentation Performance on Multimodal Medical Images Using GPT-4 Generated Descriptive Prompts Without Human Annotation
This study presents a novel multimodal medical image zero-shot segmentation algorithm named the text-visual-prompt segment anything model (TV-SAM) without any manual annotations. The TV-SAM incorporates and integrates th…
DescriptiveLanguage ModelingLanguage ModellingLarge Language Model+2Zero-shot Medical Event Prediction Using a Generative Pre-trained Transformer on Electronic Health Records
Longitudinal data in electronic health records (EHRs) represent an individual`s clinical history through a sequence of codified concepts, including diagnoses, procedures, medications, and laboratory tests. Foundational m…
DiagnosticVision Foundry: A System for Training Foundational Vision AI Models
Self-supervised learning (SSL) leverages vast unannotated medical datasets, yet steep technical barriers limit adoption by clinical researchers. We introduce Vision Foundry, a code-free, HIPAA-compliant platform that dem…
parameter-efficient fine-tuningSelf-Supervised LearningZero-shot GeneralizationRepresentation LearningZERO: Industry-ready Vision Foundation Model with Multi-modal Prompts
Foundation models have revolutionized AI, yet they struggle with zero-shot deployment in real-world industrial settings due to a lack of high-quality, domain-specific datasets. To bridge this gap, Superb AI introduces ZE…
Few-Shot Object Detection