paper-with-me

Papers

Semantic Interpretation and Validation of Graph Attention-based Explanations for GNN Models

2023-08-08 · Efimia Panagiotaki, Daniele De Martini, Lars Kunze

In this work, we propose a methodology for investigating the use of semantic attention to enhance the explainability of Graph Neural Network (GNN)-based models. Graph Deep Learning (GDL) has emerged as a promising field for tasks like scene interpretation, leveraging flexible graph structures to concisely describe complex features and relationships. As traditional explainability methods used in eXplainable AI (XAI) cannot be directly applied to such structures, graph-specific approaches are introduced. Attention has been previously employed to estimate the importance of input features in GDL, however, the fidelity of this method in generating accurate and consistent explanations has been questioned. To evaluate the validity of using attention weights as feature importance indicators, we introduce semantically-informed perturbations and correlate predicted attention weights with the accuracy of the model. Our work extends existing attention-based graph explainability methods by analysing the divergence in the attention distributions in relation to semantically sorted feature sets and the behaviour of a GNN model, efficiently estimating feature importance. We apply our methodology on a lidar pointcloud estimation model successfully identifying key semantic classes that contribute to enhanced performance, effectively generating reliable post-hoc semantic explanations.

📄 PDF Abstract BibTeX arXiv:2308.04220

Code (0)

등록된 구현이 없습니다.

Tasks

Feature ImportanceGraph AttentionGraph Neural Network

Methods 이 논문이 사용한 방법론

Graph Neural Network 설명 없음

Similar Papers 제목 키워드 기반

Rethinking Node Representation Interpretation through Relation Coherence

2024-11-01 · Ying-Chun Lin, Jennifer Neville, Cassiano Becker, Purvanshi Metha 외

Understanding node representations in graph-based models is crucial for uncovering biases ,diagnosing errors, and building trust in model decisions. However, previous work on explainable AI for node representations has p…

Relation

Fooling Neural Network Interpretations via Adversarial Model Manipulation

2019-02-06 · NeurIPS 2019 12 · Juyeon Heo, Sunghwan Joo, Taesup Moon

We ask whether the neural network interpretation methods can be fooled via adversarial model manipulation, which is defined as a model fine-tuning step that aims to radically alter the explanations without hurting the ac…

modelNetwork Interpretation

Extractive Adversarial Networks: High-Recall Explanations for Identifying Personal Attacks in Social Media Posts

2018-09-01 · EMNLP 2018 10 · Samuel Carton, Qiaozhu Mei, Paul Resnick

We introduce an adversarial method for producing high-recall explanations of neural text classifier decisions. Building on an existing architecture for extractive explanations via hard attention, we add an adversarial la…

Hard Attention

Grounded but Misleading: Evaluating Semantic Alignment in AI-Generated Security Explanations

2026-02-04 · Heajun An, Connor Ng, Sandesh Sharma Dulal, Junghwan Kim 외 arxiv

Online scams increasingly leverage fluent and context-aware social engineering strategies, creating growing demand for AI systems that explain why a message may be risky. However, explanations that cite detector-derived …

eXpath: Explaining Knowledge Graph Link Prediction with Ontological Closed Path Rules

2024-12-06 · Ye Sun, Lei Shi, Yongxin Tong

Link prediction (LP) is crucial for Knowledge Graphs (KG) completion but commonly suffers from interpretability issues. While several methods have been proposed to explain embedding-based LP models, they are generally li…

Knowledge GraphsLink Prediction