SAM-DA: Decoder Adapter for Efficient Medical Domain Adaptation
This paper addresses the domain adaptation challenge for semantic segmentation in medical imaging. Despite the impressive performance of recent foundational segmentation models like SAM on natural images, they struggle with medical domain images. Beyond this, recent approaches that perform end-to-end fine-tuning of models are simply not computationally tractable. To address this, we propose a novel SAM adapter approach that minimizes the number of trainable parameters while achieving comparable performances to full fine-tuning. The proposed SAM adapter is strategically placed in the mask decoder, offering excellent and broad generalization capabilities and improved segmentation across both fully supervised and test-time domain adaptation tasks. Extensive validation on four datasets showcases the adapter's efficacy, outperforming existing methods while training less than 1% of SAM's total parameters.
Code (0)
등록된 구현이 없습니다.
Tasks
DecoderDomain AdaptationSegmentationSemantic SegmentationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
MedAdapter: Efficient Test-Time Adaptation of Large Language Models towards Medical Reasoning
Despite their improved capabilities in generation and reasoning, adapting large language models (LLMs) to the biomedical domain remains challenging due to their immense size and corporate privacy. In this work, we propos…
Privacy PreservingTest-time AdaptationSelf-Prompt SAM: Medical Image Segmentation via Automatic Prompt SAM Adaptation
Segment Anything Model (SAM) has demonstrated impressive zero-shot performance and brought a range of unexplored capabilities to natural image segmentation tasks. However, as a very important branch of image segmentation…
Image SegmentationMedical Image SegmentationSegmentationSemantic SegmentationA Large-scale Medical Visual Task Adaptation Benchmark
Visual task adaptation has been demonstrated to be effective in adapting pre-trained Vision Transformers (ViTs) to general downstream visual tasks using specialized learnable layers or tokens. However, there is yet a lar…
Mixture-of-ExpertsMedical SAM Adapter: Adapting Segment Anything Model for Medical Image Segmentation
The Segment Anything Model (SAM) has recently gained popularity in the field of image segmentation due to its impressive capabilities in various segmentation tasks and its prompt-based interface. However, recent studies …
Image SegmentationMedical Image SegmentationSegmentationSemantic SegmentationDomain Adaptation for Learned Image Compression with Supervised Adapters
In Learned Image Compression (LIC), a model is trained at encoding and decoding images sampled from a source domain, often outperforming traditional codecs on natural images; yet its performance may be far from optimal o…
DecoderDomain AdaptationImage Compression