paper-with-me

홈 › Papers

On the Expressive Power of Graph Neural Networks

2024-01-03 · Ashwin Nalwade, Kelly Marshall, Axel Eladi, Umang Sharma

The study of Graph Neural Networks has received considerable interest in the past few years. By extending deep learning to graph-structured data, GNNs can solve a diverse set of tasks in fields including social science, chemistry, and medicine. The development of GNN architectures has largely been focused on improving empirical performance on tasks like node or graph classification. However, a line of recent work has instead sought to find GNN architectures that have desirable theoretical properties - by studying their expressive power and designing architectures that maximize this expressiveness. While there is no consensus on the best way to define the expressiveness of a GNN, it can be viewed from several well-motivated perspectives. Perhaps the most natural approach is to study the universal approximation properties of GNNs, much in the way that this has been studied extensively for MLPs. Another direction focuses on the extent to which GNNs can distinguish between different graph structures, relating this to the graph isomorphism test. Besides, a GNN's ability to compute graph properties such as graph moments has been suggested as another form of expressiveness. All of these different definitions are complementary and have yielded different recommendations for GNN architecture choices. In this paper, we would like to give an overview of the notion of "expressive power" of GNNs and provide some valuable insights regarding the design choices of GNNs.

📄 PDF Abstract BibTeX arXiv:2401.01626

Code (0)

등록된 구현이 없습니다.

Tasks

Graph Classification

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically

Similar Papers 제목 키워드 기반

Enhancing Logical Expressiveness in Graph Neural Networks via Path-Neighbor Aggregation

2025-11-11 · Han Yu, Xiaojuan Zhao, Aiping Li, Kai Chen 외 arxiv

Graph neural networks (GNNs) can effectively model structural information of graphs, making them widely used in knowledge graph (KG) reasoning. However, existing studies on the expressive power of GNNs mainly focuses on …

The expressive power of kth-order invariant graph networks

2020-07-23 · Floris Geerts

The expressive power of graph neural network formalisms is commonly measured by their ability to distinguish graphs. For many formalisms, the k-dimensional Weisfeiler-Leman (k-WL) graph isomorphism test is used as a yard…

Graph Neural Network

Towards Dynamic Graph Neural Networks with Provably High-Order Expressive Power

2024-10-02 · Zhe Wang, Tianjian Zhao, Zhen Zhang, Jiawei Chen 외

Dynamic Graph Neural Networks (DyGNNs) have garnered increasing research attention for learning representations on evolving graphs. Despite their effectiveness, the limited expressive power of existing DyGNNs hinders the…

Graph Neural Network

How Powerful are K-hop Message Passing Graph Neural Networks

2022-05-26 · Jiarui Feng, Yixin Chen, Fuhai Li, Anindya Sarkar 외

The most popular design paradigm for Graph Neural Networks (GNNs) is 1-hop message passing -- aggregating information from 1-hop neighbors repeatedly. However, the expressive power of 1-hop message passing is bounded by …

Walk Message Passing Neural Networks and Second-Order Graph Neural Networks

2020-06-16 · Floris Geerts

The expressive power of message passing neural networks (MPNNs) is known to match the expressive power of the 1-dimensional Weisfeiler-Leman graph (1-WL) isomorphism test. To boost the expressive power of MPNNs, a number…

Graph Neural Network