paper-with-me

Papers

Walking Out of the Weisfeiler Leman Hierarchy: Graph Learning Beyond Message Passing

2021-02-17 · Jan Tönshoff, Martin Ritzert, Hinrikus Wolf, Martin Grohe

We propose CRaWl, a novel neural network architecture for graph learning. Like graph neural networks, CRaWl layers update node features on a graph and thus can freely be combined or interleaved with GNN layers. Yet CRaWl operates fundamentally different from message passing graph neural networks. CRaWl layers extract and aggregate information on subgraphs appearing along random walks through a graph using 1D Convolutions. Thereby it detects long range interactions and computes non-local features. As the theoretical basis for our approach, we prove a theorem stating that the expressiveness of CRaWl is incomparable with that of the Weisfeiler Leman algorithm and hence with graph neural networks. That is, there are functions expressible by CRaWl, but not by GNNs and vice versa. This result extends to higher levels of the Weisfeiler Leman hierarchy and thus to higher-order GNNs. Empirically, we show that CRaWl matches state-of-the-art GNN architectures across a multitude of benchmark datasets for classification and regression on graphs.

📄 PDF Abstract BibTeX arXiv:2102.08786

Code (1)

toenshoff/CRaWl 공식 구현 pytorch

Tasks

Graph ClassificationGraph LearningGraph Regressionregression

Similar Papers 제목 키워드 기반

Weisfeiler and Leman Go Walking: Random Walk Kernels Revisited

2022-05-22 · Nils M. Kriege

Random walk kernels have been introduced in seminal work on graph learning and were later largely superseded by kernels based on the Weisfeiler-Leman test for graph isomorphism. We give a unified view on both classes of …

Graph Learning

Weisfeiler and Leman Go Loopy: A New Hierarchy for Graph Representational Learning

2024-03-20 · Raffaele Paolino, Sohir Maskey, Pascal Welke, Gitta Kutyniok

We introduce $r$-loopy Weisfeiler-Leman ($r$-$\ell{}$WL), a novel hierarchy of graph isomorphism tests and a corresponding GNN framework, $r$-$\ell{}$MPNN, that can count cycles up to length $r + 2$. Most notably, we sho…

Aligning Transformers with Weisfeiler-Leman

2024-06-05 · Luis Müller, Christopher Morris

Graph neural network architectures aligned with the $k$-dimensional Weisfeiler--Leman ($k$-WL) hierarchy offer theoretically well-understood expressive power. However, these architectures often fail to deliver state-of-t…

Graph Neural Network

Weisfeiler and Leman go Hyperbolic: Learning Distance Preserving Node Representations

2022-11-04 · Giannis Nikolentzos, Michail Chatzianastasis, Michalis Vazirgiannis

In recent years, graph neural networks (GNNs) have emerged as a promising tool for solving machine learning problems on graphs. Most GNNs are members of the family of message passing neural networks (MPNNs). There is a c…

Graph Classification

Weisfeiler-Leman Is Incomplete on Simple Spectrum Graphs, so Canonicalize Them

2026-05-22 · Snir Hordan, Nadav Dym, Tim Seppelt arxiv

Graphs with a simple spectrum admit cubic-time isomorphism testing, yet we prove that for every natural number $k$, the $k$-Weisfeiler-Leman ($k$-WL) test cannot distinguish all non-isomorphic graphs with a simple spectr…

Graph Regression