paper-with-me

홈 › Papers

Leveraging CAM Algorithms for Explaining Medical Semantic Segmentation

2024-09-30 · Tillmann Rheude, Andreas Wirtz, Arjan Kuijper, Stefan Wesarg

Convolutional neural networks (CNNs) achieve prevailing results in segmentation tasks nowadays and represent the state-of-the-art for image-based analysis. However, the understanding of the accurate decision-making process of a CNN is rather unknown. The research area of explainable artificial intelligence (xAI) primarily revolves around understanding and interpreting this black-box behavior. One way of interpreting a CNN is the use of class activation maps (CAMs) that represent heatmaps to indicate the importance of image areas for the prediction of the CNN. For classification tasks, a variety of CAM algorithms exist. But for segmentation tasks, only one CAM algorithm for the interpretation of the output of a CNN exist. We propose a transfer between existing classification- and segmentation-based methods for more detailed, explainable, and consistent results which show salient pixels in semantic segmentation tasks. The resulting Seg-HiRes-Grad CAM is an extension of the segmentation-based Seg-Grad CAM with the transfer to the classification-based HiRes CAM. Our method improves the previously-mentioned existing segmentation-based method by adjusting it to recently published classification-based methods. Especially for medical image segmentation, this transfer solves existing explainability disadvantages.

📄 PDF Abstract BibTeX arXiv:2409.20287

Code (1)

TillmannRheude/SegHiResGrad_CAM 공식 구현 pytorch

Tasks

ClassificationDecision MakingExplainable artificial intelligenceExplainable Artificial Intelligence (XAI)Image SegmentationMedical Image SegmentationSegmentationSemantic Segmentation

Methods 이 논문이 사용한 방법론

CAM Class activation maps could be used to interpret the prediction decision made by the convolutional neural network (CNN). Image source: [Learning Deep Features for…

Similar Papers 제목 키워드 기반

Deep Semantic Segmentation of Natural and Medical Images: A Review

2019-10-16 · Saeid Asgari Taghanaki, Kumar Abhishek, Joseph Paul Cohen, Julien Cohen-Adad 외

The semantic image segmentation task consists of classifying each pixel of an image into an instance, where each instance corresponds to a class. This task is a part of the concept of scene understanding or better explai…

Image SegmentationMedical Image AnalysisMedical Image SegmentationScene Understanding+2

Leveraging Causal Reasoning Method for Explaining Medical Image Segmentation Models

2026-02-24 · Limai Jiang, Ruitao Xie, Bokai Yang, Huazhen Huang 외 arxiv

Medical image segmentation plays a vital role in clinical decision-making, enabling precise localization of lesions and guiding interventions. Despite significant advances in segmentation accuracy, the black-box nature o…

Medical Image SegmentationCausal Inference

A large annotated medical image dataset for the development and evaluation of segmentation algorithms

2019-02-25 · Amber L. Simpson, Michela Antonelli, Spyridon Bakas, Michel Bilello 외

Semantic segmentation of medical images aims to associate a pixel with a label in a medical image without human initialization. The success of semantic segmentation algorithms is contingent on the availability of high-qu…

BenchmarkingSegmentationSemantic Segmentation

Cross-level Contrastive Learning and Consistency Constraint for Semi-supervised Medical Image Segmentation

2022-02-08 · Xinkai Zhao, Chaowei Fang, De-Jun Fan, Xutao Lin 외

Semi-supervised learning (SSL), which aims at leveraging a few labeled images and a large number of unlabeled images for network training, is beneficial for relieving the burden of data annotation in medical image segmen…

Contrastive LearningImage SegmentationLesion SegmentationMedical Image Segmentation+4

Graph-BAS3Net: Boundary-Aware Semi-Supervised Segmentation Network With Bilateral Graph Convolution

2021-01-01 · ICCV 2021 10 · Huimin Huang, Lanfen Lin, Yue Zhang, Yingying Xu 외

Semi-supervised learning (SSL) algorithms have attracted much attentions in medical image segmentation by leveraging unlabeled data, which challenge in acquiring massive pixel-wise annotated samples. However, most of…

Boundary DetectionImage SegmentationMedical Image SegmentationMulti-Task Learning+4