paper-with-me

홈 › Papers

Towards Training GNNs using Explanation Directed Message Passing

2022-11-30 · Valentina Giunchiglia, Chirag Varun Shukla, Guadalupe Gonzalez, Chirag Agarwal

With the increasing use of Graph Neural Networks (GNNs) in critical real-world applications, several post hoc explanation methods have been proposed to understand their predictions. However, there has been no work in generating explanations on the fly during model training and utilizing them to improve the expressive power of the underlying GNN models. In this work, we introduce a novel explanation-directed neural message passing framework for GNNs, EXPASS (EXplainable message PASSing), which aggregates only embeddings from nodes and edges identified as important by a GNN explanation method. EXPASS can be used with any existing GNN architecture and subgraph-optimizing explainer to learn accurate graph embeddings. We theoretically show that EXPASS alleviates the oversmoothing problem in GNNs by slowing the layer wise loss of Dirichlet energy and that the embedding difference between the vanilla message passing and EXPASS framework can be upper bounded by the difference of their respective model weights. Our empirical results show that graph embeddings learned using EXPASS improve the predictive performance and alleviate the oversmoothing problems of GNNs, opening up new frontiers in graph machine learning to develop explanation-based training frameworks.

📄 PDF Abstract BibTeX arXiv:2211.16731

Code (1)

researching-the-unknown/expass 공식 구현 pytorch

Methods 이 논문이 사용한 방법론

HOC 설명 없음

Similar Papers 제목 키워드 기반

Graph Coarsening with Message-Passing Guarantees

2024-05-28 · Antonin Joly, Nicolas Keriven

Graph coarsening aims to reduce the size of a large graph while preserving some of its key properties, which has been used in many applications to reduce computational load and memory footprint. For instance, in graph ma…

Node Classification

Message-passing selection: Towards interpretable GNNs for graph classification

2023-06-03 · Wenda Li, KaiXuan Chen, Shunyu Liu, Wenjie Huang 외

In this paper, we strive to develop an interpretable GNNs' inference paradigm, termed MSInterpreter, which can serve as a plug-and-play scheme readily applicable to various GNNs' baselines. Unlike the most existing expla…

ClassificationGraph Classification

TreeX: Generating Global Graphical GNN Explanations via Critical Subtree Extraction

2025-03-12 · Shengyao Lu, Jiuding Yang, Baochun Li, Di Niu

The growing demand for transparency and interpretability in critical domains has driven increased interests in comprehending the explainability of Message-Passing (MP) Graph Neural Networks (GNNs). Although substantial r…

EEGNN: Edge Enhanced Graph Neural Network with a Bayesian Nonparametric Graph Model

2022-08-12 · Yirui Liu, Xinghao Qiao, Liying Wang, Jessica Lam

Training deep graph neural networks (GNNs) poses a challenging task, as the performance of GNNs may suffer from the number of hidden message-passing layers. The literature has focused on the proposals of {over-smoothing}…

Graph Neural Network

Provably Powerful Graph Neural Networks for Directed Multigraphs

2023-06-20 · Béni Egressy, Luc von Niederhäusern, Jovan Blanusa, Erik Altman 외

This paper analyses a set of simple adaptations that transform standard message-passing Graph Neural Networks (GNN) into provably powerful directed multigraph neural networks. The adaptations include multigraph port numb…