LIMIS: Towards Language-based Interactive Medical Image Segmentation
Within this work, we introduce LIMIS: The first purely language-based interactive medical image segmentation model. We achieve this by adapting Grounded SAM to the medical domain and designing a language-based model interaction strategy that allows radiologists to incorporate their knowledge into the segmentation process. LIMIS produces high-quality initial segmentation masks by leveraging medical foundation models and allows users to adapt segmentation masks using only language, opening up interactive segmentation to scenarios where physicians require using their hands for other tasks. We evaluate LIMIS on three publicly available medical datasets in terms of performance and usability with experts from the medical domain confirming its high-quality segmentation masks and its interactive usability.
Code (0)
등록된 구현이 없습니다.
Tasks
Image SegmentationInteractive SegmentationMedical Image SegmentationSegmentationSemantic SegmentationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Zero-Shot Gaze-based Volumetric Medical Image Segmentation
Accurate segmentation of anatomical structures in volumetric medical images is crucial for clinical applications, including disease monitoring and cancer treatment planning. Contemporary interactive segmentation models, …
Image SegmentationInteractive SegmentationMedical Image SegmentationSegmentation+2LIMIS: Locally Interpretable Modeling using Instance-wise Subsampling
Understanding black-box machine learning models is crucial for their widespread adoption. Learning globally interpretable models is one approach, but achieving high performance with them is challenging. An alternative ap…
Reinforcement LearningReinforcement Learning (RL)Interactive Medical Image Segmentation: A Benchmark Dataset and Baseline
Interactive Medical Image Segmentation (IMIS) has long been constrained by the limited availability of large-scale, diverse, and densely annotated datasets, which hinders model generalization and consistent evaluation ac…
Image SegmentationInteractive SegmentationMedical Image SegmentationObject Recognition+2Interactive Medical Image Segmentation with Self-Adaptive Confidence Calibration
Medical image segmentation is one of the fundamental problems for artificial intelligence-based clinical decision systems. Current automatic medical image segmentation methods are often failed to meet clinical requiremen…
Image SegmentationInteractive SegmentationMedical Image SegmentationMulti-agent Reinforcement Learning+2Dynamic Prompt Generation for Interactive 3D Medical Image Segmentation Training
Interactive 3D biomedical image segmentation requires efficient models that can iteratively refine predictions based on user prompts. Current foundation models either lack volumetric awareness or suffer from limited inte…
Medical Image Segmentation