paper-with-me

홈 › Papers

EP-SAM: Weakly Supervised Histopathology Segmentation via Enhanced Prompt with Segment Anything

2024-10-17 · Joonhyeon Song, Seohwan Yun, Seongho Yoon, Joohyeok Kim, Sangmin Lee

This work proposes a novel approach beyond supervised learning for effective pathological image analysis, addressing the challenge of limited robust labeled data. Pathological diagnosis of diseases like cancer has conventionally relied on the evaluation of morphological features by physicians and pathologists. However, recent advancements in compute-aided diagnosis (CAD) systems are gaining significant attention as diagnostic support tools. Although the advancement of deep learning has improved CAD significantly, segmentation models typically require large pixel-level annotated dataset, and such labeling is expensive. Existing studies not based on supervised approaches still struggle with limited generalization, and no practical approach has emerged yet. To address this issue, we present a weakly supervised semantic segmentation (WSSS) model by combining class activation map and Segment Anything Model (SAM)-based pseudo-labeling. For effective pretraining, we adopt the SAM-a foundation model that is pretrained on large datasets and operates in zero-shot configurations using only coarse prompts. The proposed approach transfer enhanced Attention Dropout Layer's knowledge to SAM, thereby generating pseudo-labels. To demonstrate the superiority of the proposed method, experimental studies are conducted on histopathological breast cancer datasets. The proposed method outperformed other WSSS methods across three datasets, demonstrating its efficiency by achieving this with only 12GB of GPU memory during training. Our code is available at : https://github.com/QI-NemoSong/EP-SAM

📄 PDF Abstract BibTeX arXiv:2410.13621

Code (2)

qi-nemosong/ep-sam 공식 구현 pytorch
qi-nemosong/eplc-sam 공식 구현 pytorch

Tasks

DiagnosticGPUSemantic SegmentationWeakly supervised Semantic SegmentationWeakly-Supervised Semantic Segmentation

Methods 이 논문이 사용한 방법론

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Attention 설명 없음
SAM 설명 없음
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Attention Dropout Attention Dropout is a type of dropout used in attention-based architectures, where elements are randomly dropped out of the…

Similar Papers 제목 키워드 기반

CAMEL: A Weakly Supervised Learning Framework for Histopathology Image Segmentation

2019-08-28 · ICCV 2019 10 · Gang Xu, Zhigang Song, Zhuo Sun, Calvin Ku 외

Histopathology image analysis plays a critical role in cancer diagnosis and treatment. To automatically segment the cancerous regions, fully supervised segmentation algorithms require labor-intensive and time-consuming l…

Image SegmentationMultiple Instance LearningSegmentationSemantic Segmentation+1

A Comprehensive Analysis of Weakly-Supervised Semantic Segmentation in Different Image Domains

2019-12-24 · Lyndon Chan, Mahdi S. Hosseini, Konstantinos N. Plataniotis

Recently proposed methods for weakly-supervised semantic segmentation have achieved impressive performance in predicting pixel classes despite being trained with only image labels which lack positional information. Becau…

SegmentationSemantic SegmentationWeakly supervised Semantic SegmentationWeakly-Supervised Semantic Segmentation

Weakly supervised segmentation with point annotations for histopathology images via contrast-based variational model

2023-04-07 · CVPR 2023 1 · Hongrun Zhang, Liam Burrows, Yanda Meng, Declan Sculthorpe 외

Image segmentation is a fundamental task in the field of imaging and vision. Supervised deep learning for segmentation has achieved unparalleled success when sufficient training data with annotated labels are available. …

Image SegmentationSegmentationSemantic SegmentationWeakly-supervised Learning+1

Transformer based multiple instance learning for weakly supervised histopathology image segmentation

2022-05-18 · Ziniu Qian, Kailu Li, Maode Lai, Eric I-Chao Chang 외

Hispathological image segmentation algorithms play a critical role in computer aided diagnosis technology. The development of weakly supervised segmentation algorithm alleviates the problem of medical image annotation th…

Image SegmentationMultiple Instance LearningSegmentationSemantic Segmentation+2

Weakly Supervised Registration of Prostate MRI and Histopathology Images

2021-06-23 · Wei Shao, Indrani Bhattacharya, Simon J. C. Soerensen, Christian A. Kunder 외

The interpretation of prostate MRI suffers from low agreement across radiologists due to the subtle differences between cancer and normal tissue. Image registration addresses this issue by accurately mapping the ground-t…

Image Registration