paper-with-me

Papers

Subgraph Permutation Equivariant Networks

2021-11-23 · Joshua Mitton, Roderick Murray-Smith

In this work we develop a new method, named Sub-graph Permutation Equivariant Networks (SPEN), which provides a framework for building graph neural networks that operate on sub-graphs, while using a base update function that is permutation equivariant, that are equivariant to a novel choice of automorphism group. Message passing neural networks have been shown to be limited in their expressive power and recent approaches to over come this either lack scalability or require structural information to be encoded into the feature space. The general framework presented here overcomes the scalability issues associated with global permutation equivariance by operating more locally on sub-graphs. In addition, through operating on sub-graphs the expressive power of higher-dimensional global permutation equivariant networks is improved; this is due to fact that two non-distinguishable graphs often contain distinguishable sub-graphs. Furthermore, the proposed framework only requires a choice of $k$-hops for creating ego-network sub-graphs and a choice of representation space to be used for each layer, which makes the method easily applicable across a range of graph based domains. We experimentally validate the method on a range of graph benchmark classification tasks, demonstrating statistically indistinguishable results from the state-of-the-art on six out of seven benchmarks. Further, we demonstrate that the use of local update functions offers a significant improvement in GPU memory over global methods.

📄 PDF Abstract BibTeX arXiv:2111.11840

Code (0)

등록된 구현이 없습니다.

Tasks

GPU

Similar Papers 제목 키워드 기반

SpeqNets: Sparsity-aware Permutation-equivariant Graph Networks

2022-03-25 · Christopher Morris, Gaurav Rattan, Sandra Kiefer, Siamak Ravanbakhsh

While (message-passing) graph neural networks have clear limitations in approximating permutation-equivariant functions over graphs or general relational data, more expressive, higher-order graph neural networks do not s…

Graph Neural Network

A Flexible, Equivariant Framework for Subgraph GNNs via Graph Products and Graph Coarsening

2024-06-13 · Guy Bar-Shalom, Yam Eitan, Fabrizio Frasca, Haggai Maron

Subgraph Graph Neural Networks (Subgraph GNNs) enhance the expressivity of message-passing GNNs by representing graphs as sets of subgraphs. They have shown impressive performance on several tasks, but their complexity l…

Graph Learning

P-tensors: a General Formalism for Constructing Higher Order Message Passing Networks

2023-06-19 · Tianyi Sun, Andrew Hands, Risi Kondor

Several recent papers have recently shown that higher order graph neural networks can achieve better accuracy than their standard message passing counterparts, especially on highly structured graphs such as molecules. Th…

Autobahn: Automorphism-based Graph Neural Nets

2021-03-02 · NeurIPS 2021 12 · Erik Henning Thiede, Wenda Zhou, Risi Kondor

We introduce Automorphism-based graph neural networks (Autobahn), a new family of graph neural networks. In an Autobahn, we decompose the graph into a collection of subgraphs and apply local convolutions that are equivar…

Graph Neural Network

On Universal Equivariant Set Networks

2019-10-06 · ICLR 2020 1 · Nimrod Segol, Yaron Lipman

Using deep neural networks that are either invariant or equivariant to permutations in order to learn functions on unordered sets has become prevalent. The most popular, basic models are DeepSets [Zaheer et al. 2017] and…

Point Cloud Segmentation