paper-with-me

Papers

Adapting Segment Anything Model (SAM) through Prompt-based Learning for Enhanced Protein Identification in Cryo-EM Micrographs

2023-11-04 · Fei He, Zhiyuan Yang, Mingyue Gao, Biplab Poudel, Newgin Sam Ebin Sam Dhas, Rajan Gyawali, Ashwin Dhakal, Jianlin Cheng, Dong Xu

Cryo-electron microscopy (cryo-EM) remains pivotal in structural biology, yet the task of protein particle picking, integral for 3D protein structure construction, is laden with manual inefficiencies. While recent AI tools such as Topaz and crYOLO are advancing the field, they do not fully address the challenges of cryo-EM images, including low contrast, complex shapes, and heterogeneous conformations. This study explored prompt-based learning to adapt the state-of-the-art image segmentation foundation model Segment Anything Model (SAM) for cryo-EM. This focus was driven by the desire to optimize model performance with a small number of labeled data without altering pre-trained parameters, aiming for a balance between adaptability and foundational knowledge retention. Through trials with three prompt-based learning strategies, namely head prompt, prefix prompt, and encoder prompt, we observed enhanced performance and reduced computational requirements compared to the fine-tuning approach. This work not only highlights the potential of prompting SAM in protein identification from cryo-EM micrographs but also suggests its broader promise in biomedical image segmentation and object detection.

📄 PDF Abstract BibTeX arXiv:2311.16140

Code (1)

yangyang-69/Prompt_sam_cryoPPP 공식 구현 pytorch

Tasks

Image Segmentationobject-detectionObject DetectionSemantic Segmentation

Methods 이 논문이 사용한 방법론

SAM 설명 없음
Focus 설명 없음

Similar Papers 제목 키워드 기반

Adapting Segment Anything Model to Melanoma Segmentation in Microscopy Slide Images

2024-10-03 · Qingyuan Liu, Avideh Zakhor

Melanoma segmentation in Whole Slide Images (WSIs) is useful for prognosis and the measurement of crucial prognostic factors such as Breslow depth and primary invasive tumor size. In this paper, we present a novel approa…

parameter-efficient fine-tuningPrognosisSegmentationSemantic Segmentation+1

ViPSAM: Visual Prompting Medical Image Segmentation Using Segment Anything Model

2026-07-15 · San Lee, Nalee Kim, Jeong Il Yu, Hee Chul Park 외 arxiv

In proton therapy planning, respiratory-gated non-contrast CT (NCCT) is commonly used for lesion segmentation; however, accurate delineation remains challenging due to low lesion-to-background contrast. Although learning…

Medical Image SegmentationLesion Segmentation

AlignSAM: Aligning Segment Anything Model to Open Context via Reinforcement Learning

2024-06-01 · CVPR 2024 1 · Duojun Huang, Xinyu Xiong, Jie Ma, Jichang Li 외

Powered by massive curated training data, Segment Anything Model (SAM) has demonstrated its impressive generalization capabilities in open-world scenarios with the guidance of prompts. However, the vanilla SAM is class a…

reinforcement-learningReinforcement LearningSegmentation

EVF-SAM: Early Vision-Language Fusion for Text-Prompted Segment Anything Model

2024-06-28 · Yuxuan Zhang, Tianheng Cheng, Rui Hu, Lei Liu 외

Segment Anything Model (SAM) has attracted widespread attention for its superior interactive segmentation capabilities with visual prompts while lacking further exploration of text prompts. In this paper, we empirically …

Interactive SegmentationLanguage ModelingLanguage ModellingReferring Expression+2

Promptable Foundation Models for SAR Remote Sensing: Adapting the Segment Anything Model for Snow Avalanche Segmentation

2026-01-03 · Riccardo Gelato, Carlo Sgaravatti, Jakob Grahn, Giacomo Boracchi 외 arxiv

Remote sensing solutions for avalanche segmentation and mapping are key to supporting risk forecasting and mitigation in mountain regions. Synthetic Aperture Radar (SAR) imagery from Sentinel-1 can be effectively used fo…