paper-with-me

Papers

SAM2-Adapter: Evaluating & Adapting Segment Anything 2 in Downstream Tasks: Camouflage, Shadow, Medical Image Segmentation, and More

2024-08-08 · Tianrun Chen, Ankang Lu, Lanyun Zhu, Chaotao Ding, Chunan Yu, Deyi Ji, Zejian Li, Lingyun Sun, Papa Mao, Ying Zang

The advent of large models, also known as foundation models, has significantly transformed the AI research landscape, with models like Segment Anything (SAM) achieving notable success in diverse image segmentation scenarios. Despite its advancements, SAM encountered limitations in handling some complex low-level segmentation tasks like camouflaged object and medical imaging. In response, in 2023, we introduced SAM-Adapter, which demonstrated improved performance on these challenging tasks. Now, with the release of Segment Anything 2 (SAM2), a successor with enhanced architecture and a larger training corpus, we reassess these challenges. This paper introduces SAM2-Adapter, the first adapter designed to overcome the persistent limitations observed in SAM2 and achieve new state-of-the-art (SOTA) results in specific downstream tasks including medical image segmentation, camouflaged (concealed) object detection, and shadow detection. SAM2-Adapter builds on the SAM-Adapter's strengths, offering enhanced generalizability and composability for diverse applications. We present extensive experimental results demonstrating SAM2-Adapter's effectiveness. We show the potential and encourage the research community to leverage the SAM2 model with our SAM2-Adapter for achieving superior segmentation outcomes. Code, pre-trained models, and data processing protocols are available at http://tianrun-chen.github.io/SAM-Adaptor/

📄 PDF Abstract BibTeX arXiv:2408.04579

Code (1)

tianrun-chen/sam-adapter-pytorch pytorch

Tasks

Image SegmentationMedical Image Segmentationobject-detectionObject DetectionRobot Manipulation GeneralizationSegmentationSemantic SegmentationShadow Detection

Methods 이 논문이 사용한 방법론

Adapter 설명 없음
SAM 설명 없음

Similar Papers 제목 키워드 기반

SAM Fails to Segment Anything? -- SAM-Adapter: Adapting SAM in Underperformed Scenes: Camouflage, Shadow, Medical Image Segmentation, and More

2023-04-18 · Tianrun Chen, Lanyun Zhu, Chaotao Ding, Runlong Cao 외

The emergence of large models, also known as foundation models, has brought significant advancements to AI research. One such model is Segment Anything (SAM), which is designed for image segmentation tasks. However, as w…

General KnowledgeImage SegmentationMedical Image SegmentationObject+5

AdapterShadow: Adapting Segment Anything Model for Shadow Detection

2023-11-15 · Leiping Jie, HUI ZHANG

Segment anything model (SAM) has shown its spectacular performance in segmenting universal objects, especially when elaborate prompts are provided. However, the drawback of SAM is twofold. On the first hand, it fails to …

modelShadow Detection

Medical SAM Adapter: Adapting Segment Anything Model for Medical Image Segmentation

2023-04-25 · Junde Wu, Wei Ji, Yuanpei Liu, Huazhu Fu 외

The Segment Anything Model (SAM) has recently gained popularity in the field of image segmentation due to its impressive capabilities in various segmentation tasks and its prompt-based interface. However, recent studies …

Image SegmentationMedical Image SegmentationSegmentationSemantic Segmentation

SAM3-Adapter: Efficient Adaptation of Segment Anything 3 for Camouflage Object Segmentation, Shadow Detection, and Medical Image Segmentation

2025-11-24 · Tianrun Chen, Runlong Cao, Xinda Yu, Lanyun Zhu 외 arxiv

The rapid rise of large-scale foundation models has reshaped the landscape of image segmentation, with models such as Segment Anything achieving unprecedented versatility across diverse vision tasks. However, previous ge…

Medical Image SegmentationObject SegmentationShadow DetectionObject Detection

Ultrasound SAM Adapter: Adapting SAM for Breast Lesion Segmentation in Ultrasound Images

2024-04-23 · Zhengzheng Tu, Le Gu, Xixi Wang, Bo Jiang

Segment Anything Model (SAM) has recently achieved amazing results in the field of natural image segmentation. However, it is not effective for medical image segmentation, owing to the large domain gap between natural an…

Image SegmentationLesion SegmentationMedical Image SegmentationSegmentation+1