paper-with-me

Papers

Adapting Segment Anything Model to Melanoma Segmentation in Microscopy Slide Images

2024-10-03 · Qingyuan Liu, Avideh Zakhor

Melanoma segmentation in Whole Slide Images (WSIs) is useful for prognosis and the measurement of crucial prognostic factors such as Breslow depth and primary invasive tumor size. In this paper, we present a novel approach that uses the Segment Anything Model (SAM) for automatic melanoma segmentation in microscopy slide images. Our method employs an initial semantic segmentation model to generate preliminary segmentation masks that are then used to prompt SAM. We design a dynamic prompting strategy that uses a combination of centroid and grid prompts to achieve optimal coverage of the super high-resolution slide images while maintaining the quality of generated prompts. To optimize for invasive melanoma segmentation, we further refine the prompt generation process by implementing in-situ melanoma detection and low-confidence region filtering. We select Segformer as the initial segmentation model and EfficientSAM as the segment anything model for parameter-efficient fine-tuning. Our experimental results demonstrate that this approach not only surpasses other state-of-the-art melanoma segmentation methods but also significantly outperforms the baseline Segformer by 9.1% in terms of IoU.

📄 PDF Abstract BibTeX arXiv:2410.02207

Code (0)

등록된 구현이 없습니다.

Tasks

parameter-efficient fine-tuningPrognosisSegmentationSemantic Segmentationwhole slide images

Methods 이 논문이 사용한 방법론

Refunds@Expedia|||How do I get a full refund from Expedia? “How do I get a full refund from Expedia? How do I get a full refund from Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Quick Help &…
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Residual Connection 설명 없음
Mix-FFN Mix-FFN is a feedforward layer used in the SegFormer architecture.…
SegFormer SegFormer is a Transformer-based framework for semantic segmentation that unifies Transformers with lightweight…
SAM 설명 없음

Similar Papers 제목 키워드 기반

Segment Anything for Microscopy

2023-08-22 · bioRxiv 2023 8 · Anwai Archit, Sushmita Nair, Nabeel Khalid, Paul Hilt 외

We present Segment Anything for Microscopy, a tool for interactive and automatic segmentation and tracking of objects in multi-dimensional microscopy data. Our method is based on Segment Anything, a vision foundation mod…

Image SegmentationInstance SegmentationObject TrackingSegmentation+1

Segment Anything for Dendrites from Electron Microscopy

2024-11-04 · Zewen Zhuo, Ilya Belevich, Ville Leinonen, Eija Jokitalo 외

Segmentation of cellular structures in electron microscopy (EM) images is fundamental to analyzing the morphology of neurons and glial cells in the healthy and diseased brain tissue. Current neuronal segmentation applica…

HippocampusSegmentation

Revisiting foundation models for cell instance segmentation

2026-03-18 · Anwai Archit, Constantin Pape arxiv

Cell segmentation is a fundamental task in microscopy image analysis. Several foundation models for cell segmentation have been introduced, virtually all of them are extensions of Segment Anything Model (SAM), improving …

Instance SegmentationCell Segmentation

Unifying Segment Anything in Microscopy with Multimodal Large Language Model

2025-05-16 · Manyu Li, Ruian He, Zixian Zhang, Weimin Tan 외

Accurate segmentation of regions of interest in biomedical images holds substantial value in image analysis. Although several foundation models for biomedical segmentation have currently achieved excellent performance on…

Language ModelingLanguage ModellingLarge Language ModelMultimodal Large Language Model

Adapting Segment Anything Model (SAM) through Prompt-based Learning for Enhanced Protein Identification in Cryo-EM Micrographs

2023-11-04 · Fei He, Zhiyuan Yang, Mingyue Gao, Biplab Poudel 외

Cryo-electron microscopy (cryo-EM) remains pivotal in structural biology, yet the task of protein particle picking, integral for 3D protein structure construction, is laden with manual inefficiencies. While recent AI too…

Image Segmentationobject-detectionObject DetectionSemantic Segmentation