paper-with-me

홈 › Papers

AS-XAI: Self-supervised Automatic Semantic Interpretation for CNN

2023-12-02 · Changqi Sun, Hao Xu, Yuntian Chen, Dongxiao Zhang

Explainable artificial intelligence (XAI) aims to develop transparent explanatory approaches for "black-box" deep learning models. However,it remains difficult for existing methods to achieve the trade-off of the three key criteria in interpretability, namely, reliability, causality, and usability, which hinder their practical applications. In this paper, we propose a self-supervised automatic semantic interpretable explainable artificial intelligence (AS-XAI) framework, which utilizes transparent orthogonal embedding semantic extraction spaces and row-centered principal component analysis (PCA) for global semantic interpretation of model decisions in the absence of human interference, without additional computational costs. In addition, the invariance of filter feature high-rank decomposition is used to evaluate model sensitivity to different semantic concepts. Extensive experiments demonstrate that robust and orthogonal semantic spaces can be automatically extracted by AS-XAI, providing more effective global interpretability for convolutional neural networks (CNNs) and generating human-comprehensible explanations. The proposed approach offers broad fine-grained extensible practical applications, including shared semantic interpretation under out-of-distribution (OOD) categories, auxiliary explanations for species that are challenging to distinguish, and classification explanations from various perspectives.

📄 PDF Abstract BibTeX arXiv:2312.14935

Code (1)

qi657/as-xai 공식 구현 pytorch

Tasks

Explainable artificial intelligenceExplainable Artificial Intelligence (XAI)

Similar Papers 제목 키워드 기반

From Common Sense Reasoning to Neural Network Models through Multiple Preferences: an overview

2021-07-10 · Laura Giordano, Valentina Gliozzi, Daniele Theseider Dupré

In this paper we discuss the relationships between conditional and preferential logics and neural network models, based on a multi-preferential semantics. We propose a concept-wise multipreference semantics, recently int…

Common Sense Reasoning

Unsupervised Segmentation by Diffusing, Walking and Cutting

2024-12-06 · Daniela Ivanova, Marco Aversa, Paul Henderson, John Williamson

We propose an unsupervised image segmentation method using features from pre-trained text-to-image diffusion models. Inspired by classic spectral clustering approaches, we construct adjacency matrices from self-attention…

Image SegmentationSegmentationSemantic SegmentationUnsupervised Image Segmentation

Self-supervised Automatic Matting

2026-07-11 · Xiaonan Hu, Zhiyuan Lu, Jingdong Zhao, Hao Lu arxiv

High-quality alpha mattes are notoriously expensive to annotate, creating a fundamental data bottleneck for deep image matting. While prior work attempts to reduce annotation cost using coarser labels like trimaps or mas…

Image Matting

Exploring the Utility of Self-Supervised Pretraining Strategies for the Detection of Absent Lung Sliding in M-Mode Lung Ultrasound

2023-04-05 · Blake VanBerlo, Brian Li, Alexander Wong, Jesse Hoey 외

Self-supervised pretraining has been observed to improve performance in supervised learning tasks in medical imaging. This study investigates the utility of self-supervised pretraining prior to conducting supervised fine…

Data Augmentation

Self-supervised Depth Estimation to Regularise Semantic Segmentation in Knee Arthroscopy

2020-07-05 · Fengbei Liu, Yaqub Jonmohamadi, Gabriel Maicas, Ajay K. Pandey 외

Intra-operative automatic semantic segmentation of knee joint structures can assist surgeons during knee arthroscopy in terms of situational awareness. However, due to poor imaging conditions (e.g., low texture, overexpo…

Depth EstimationMonocular Depth EstimationSegmentationSemantic Segmentation