From Explanations to Segmentation: Using Explainable AI for Image Segmentation
The new era of image segmentation leveraging the power of Deep Neural Nets (DNNs) comes with a price tag: to train a neural network for pixel-wise segmentation, a large amount of training samples has to be manually labeled on pixel-precision. In this work, we address this by following an indirect solution. We build upon the advances of the Explainable AI (XAI) community and extract a pixel-wise binary segmentation from the output of the Layer-wise Relevance Propagation (LRP) explaining the decision of a classification network. We show that we achieve similar results compared to an established U-Net segmentation architecture, while the generation of the training data is significantly simplified. The proposed method can be trained in a weakly supervised fashion, as the training samples must be only labeled on image-level, at the same time enabling the output of a segmentation mask. This makes it especially applicable to a wider range of real applications where tedious pixel-level labelling is often not possible.
Code (0)
등록된 구현이 없습니다.
Tasks
Explainable Artificial Intelligence (XAI)Image SegmentationSegmentationSemantic SegmentationTAGMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Counterfactuals and Uncertainty-Based Explainable Paradigm for the Automated Detection and Segmentation of Renal Cysts in Computed Tomography Images: A Multi-Center Study
Routine computed tomography (CT) scans often detect a wide range of renal cysts, some of which may be malignant. Early and precise localization of these cysts can significantly aid quantitative image analysis. Current se…
Computed Tomography (CT)counterfactualGenerative Adversarial NetworkImage Generation+1Explainable Medical Image Segmentation via Generative Adversarial Networks and Layer-wise Relevance Propagation
This paper contributes to automating medical image segmentation by proposing generative adversarial network-based models to segment both polyps and instruments in endoscopy images. A major contribution of this work is to…
Generative Adversarial NetworkImage SegmentationMedical Image SegmentationSegmentation+1Evolved Explainable Classifications for Lymph Node Metastases
A novel evolutionary approach for Explainable Artificial Intelligence is presented: the "Evolved Explanations" model (EvEx). This methodology consists in combining Local Interpretable Model Agnostic Explanations (LIME) w…
Binary ClassificationDecision MakingExplainable artificial intelligenceimage-classification+2Here Comes the Explanation: A Shapley Perspective on Multi-contrast Medical Image Segmentation
Deep learning has been successfully applied to medical image segmentation, enabling accurate identification of regions of interest such as organs and lesions. This approach works effectively across diverse datasets, incl…
Brain Tumor SegmentationImage SegmentationMedical Image SegmentationMRI segmentation+3From Classification to Segmentation with Explainable AI: A Study on Crack Detection and Growth Monitoring
Monitoring surface cracks in infrastructure is crucial for structural health monitoring. Automatic visual inspection offers an effective solution, especially in hard-to-reach areas. Machine learning approaches have prove…
Explainable artificial intelligenceExplainable Artificial Intelligence (XAI)SegmentationStructural Health Monitoring