paper-with-me

홈 › Papers

Perks and Pitfalls of Faithfulness in Regular, Self-Explainable and Domain Invariant GNNs

2024-06-21 · Steve Azzolin, Antonio Longa, Stefano Teso, Andrea Passerini

As Graph Neural Networks (GNNs) become more pervasive, it becomes paramount to build robust tools for computing explanations of their predictions. A key desideratum is that these explanations are faithful, i.e., that they portray an accurate picture of the GNN's reasoning process. A number of different faithfulness metrics exist, begging the question of what faithfulness is exactly, and what its properties are. We begin by showing that existing metrics are not interchangeable -- i.e., explanations attaining high faithfulness according to one metric may be unfaithful according to others -- and can be systematically insensitive to important properties of the explanation, and suggest how to address these issues. We proceed to show that, surprisingly, optimizing for faithfulness is not always a sensible design goal. Specifically, we show that for injective regular GNN architectures, perfectly faithful explanations are completely uninformative. The situation is different for modular GNNs, such as self-explainable and domain-invariant architectures, where optimizing faithfulness does not compromise informativeness, and is also unexpectedly tied to out-of-distribution generalization.

📄 PDF Abstract BibTeX arXiv:2406.15156

Code (0)

등록된 구현이 없습니다.

Tasks

InformativenessOut-of-Distribution Generalization

Similar Papers 제목 키워드 기반

How Faithful are Self-Explainable GNNs?

2023-08-29 · Marc Christiansen, Lea Villadsen, Zhiqiang Zhong, Stefano Teso 외

Self-explainable deep neural networks are a recent class of models that can output ante-hoc local explanations that are faithful to the model's reasoning, and as such represent a step forward toward filling the gap betwe…

RamanNet: A generalized neural network architecture for Raman Spectrum Analysis

2022-01-20 · Nabil Ibtehaz, Muhammad E. H. Chowdhury, Amith Khandakar, Susu M. Zughaier 외

Raman spectroscopy provides a vibrational profile of the molecules and thus can be used to uniquely identify different kind of materials. This sort of fingerprinting molecules has thus led to widespread application of Ra…

BIG-bench Machine LearningVirology

Explainability Pitfalls: Beyond Dark Patterns in Explainable AI

2021-09-26 · Upol Ehsan, Mark O. Riedl

To make Explainable AI (XAI) systems trustworthy, understanding harmful effects is just as important as producing well-designed explanations. In this paper, we address an important yet unarticulated type of negative effe…

Explainable Artificial Intelligence (XAI)

Personal-ITY: A Novel YouTube-based Corpus for Personality Prediction in Italian

2020-11-11 · Elisa Bassignana, Malvina Nissim, Viviana Patti

We present a novel corpus for personality prediction in Italian, containing a larger number of authors and a different genre compared to previously available resources. The corpus is built exploiting Distant Supervision,…

Prediction

Towards Faithful Agentic XAI: A Verification Method and an Open-World Benchmark for Better Model Faithfulness

2026-05-27 · Jaechang Kim, Sunung Mun, Seungjoon Lee, Jaewoong Cho 외 arxiv

Explainable AI (XAI) helps users interpret model behavior and identify potential faults. Agentic XAI systems use Large Language Models (LLMs) to make explanations more accessible through natural-language interaction, but…

Reinforcement Learning