paper-with-me

홈 › Papers

Learning How to Propagate Messages in Graph Neural Networks

2023-10-01 · Teng Xiao, Zhengyu Chen, Donglin Wang, Suhang Wang

This paper studies the problem of learning message propagation strategies for graph neural networks (GNNs). One of the challenges for graph neural networks is that of defining the propagation strategy. For instance, the choices of propagation steps are often specialized to a single graph and are not personalized to different nodes. To compensate for this, in this paper, we present learning to propagate, a general learning framework that not only learns the GNN parameters for prediction but more importantly, can explicitly learn the interpretable and personalized propagate strategies for different nodes and various types of graphs. We introduce the optimal propagation steps as latent variables to help find the maximum-likelihood estimation of the GNN parameters in a variational Expectation-Maximization (VEM) framework. Extensive experiments on various types of graph benchmarks demonstrate that our proposed framework can significantly achieve better performance compared with the state-of-the-art methods, and can effectively learn personalized and interpretable propagate strategies of messages in GNNs.

📄 PDF Abstract BibTeX arXiv:2310.00697

Code (1)

tengxiao1/l2p 공식 구현 pytorch

Similar Papers 제목 키워드 기반

Asynchronous Neural Networks for Learning in Graphs

2022-05-24 · Lukas Faber, Roger Wattenhofer

This paper studies asynchronous message passing (AMP), a new paradigm for applying neural network based learning to graphs. Existing graph neural networks use the synchronous distributed computing model and aggregate the…

Distributed ComputingGraph Classification

On the Bottleneck of Graph Neural Networks and its Practical Implications

2020-06-09 · ICLR 2021 1 · Uri Alon, Eran Yahav

Since the proposal of the graph neural network (GNN) by Gori et al. (2005) and Scarselli et al. (2008), one of the major problems in training GNNs was their struggle to propagate information between distant nodes in the …

Graph Neural Network

Meta-multigraph Search: Rethinking Meta-structure on Heterogeneous Information Networks

2023-04-23 · Chao Li, Hao Xu, Kun He

Meta-structures are widely used to define which subset of neighbors to aggregate information in heterogeneous information networks (HINs). In this work, we investigate existing meta-structures, including meta-path and me…

Node Classification

GNN-FiLM: Graph Neural Networks with Feature-wise Linear Modulation

2019-06-28 · ICML 2020 1 · Marc Brockschmidt

This paper presents a new Graph Neural Network (GNN) type using feature-wise linear modulation (FiLM). Many standard GNN variants propagate information along the edges of a graph by computing "messages" based only on the…

Graph Neural Network

Uncertainty Propagation in Node Classification

2023-04-03 · Zhao Xu, Carolin Lawrence, Ammar Shaker, Raman Siarheyeu

Quantifying predictive uncertainty of neural networks has recently attracted increasing attention. In this work, we focus on measuring uncertainty of graph neural networks (GNNs) for the task of node classification. Most…

ClassificationNode Classification