paper-with-me

Papers

SpeqNets: Sparsity-aware Permutation-equivariant Graph Networks

2022-03-25 · Christopher Morris, Gaurav Rattan, Sandra Kiefer, Siamak Ravanbakhsh

While (message-passing) graph neural networks have clear limitations in approximating permutation-equivariant functions over graphs or general relational data, more expressive, higher-order graph neural networks do not scale to large graphs. They either operate on $k$-order tensors or consider all $k$-node subgraphs, implying an exponential dependence on $k$ in memory requirements, and do not adapt to the sparsity of the graph. By introducing new heuristics for the graph isomorphism problem, we devise a class of universal, permutation-equivariant graph networks, which, unlike previous architectures, offer a fine-grained control between expressivity and scalability and adapt to the sparsity of the graph. These architectures lead to vastly reduced computation times compared to standard higher-order graph networks in the supervised node- and graph-level classification and regression regime while significantly improving over standard graph neural network and graph kernel architectures in terms of predictive performance.

📄 PDF Abstract BibTeX arXiv:2203.13913

Code (1)

chrsmrrs/speqnets 공식 구현 pytorch

Tasks

Graph Neural Network

Methods 이 논문이 사용한 방법론

Graph Neural Network 설명 없음

Similar Papers 제목 키워드 기반

Permutation Equivariant Graph Framelets for Heterophilous Graph Learning

2023-06-07 · Jianfei Li, Ruigang Zheng, Han Feng, Ming Li 외

The nature of heterophilous graphs is significantly different from that of homophilous graphs, which causes difficulties in early graph neural network models and suggests aggregations beyond the 1-hop neighborhood. In th…

Graph LearningGraph Neural Network

Gromov-Monge Flow Matching for Equivariant Graph Generation

2026-08-27 · Moritz Piening, Christian Wald arxiv

Graphs are invariant under node permutations, motivating the use of permutation-equivariant architectures in generative models. In flow matching, however, symmetry may also enter the source--target coupling: once graph p…

Graph Generation

The general theory of permutation equivarant neural networks and higher order graph variational encoders

2020-04-08 · Erik Henning Thiede, Truong Son Hy, Risi Kondor

Previous work on symmetric group equivariant neural networks generally only considered the case where the group acts by permuting the elements of a single vector. In this paper we derive formulae for general permutation …

Graph GenerationGraph LearningLink PredictionMolecular Graph Generation

Subgraph Permutation Equivariant Networks

2021-11-23 · Joshua Mitton, Roderick Murray-Smith

In this work we develop a new method, named Sub-graph Permutation Equivariant Networks (SPEN), which provides a framework for building graph neural networks that operate on sub-graphs, while using a base update function …

GPU

Geometry of Linear Neural Networks: Equivariance and Invariance under Permutation Groups

2023-09-24 · Kathlén Kohn, Anna-Laura Sattelberger, Vahid Shahverdi

The set of functions parameterized by a linear fully-connected neural network is a determinantal variety. We investigate the subvariety of functions that are equivariant or invariant under the action of a permutation gro…