paper-with-me

홈 › Papers

Invariant-Based Weight Sharing for Message Passing

2026-05-25 · Florian Seiffarth arxiv

Message-passing neural networks (MPNNs) are a powerful framework for learning representations of graph-structured domains. However, weights in MPNNs act on features only, limiting their ability to capture structural patterns. We introduce a novel structure-aware weight sharing principle that explicitly incorporates information inherent to the graph structure. Weights are indexed directly by user-chosen graph invariants, i.e., functions preserved under node permutations, enabling systematic reuse across structurally equivalent subgraphs. We present ShareGNNs, which instantiate this principle within a simple encoder-decoder architecture, resulting in an MPNN with learnable adjacency and transformer-like connectivity. We show that their expressivity is at least as strong as the discriminative power of the chosen invariants, providing explicit control over the model complexity. Experiments on synthetic and real-world data, as well as subgraph counting tasks, demonstrate consistent improvements over standard MPNNs, competitive expressivity beyond the 1-WL test, and scalability to large datasets.

📄 PDF Abstract BibTeX arXiv:2605.25750

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

LDPC Decoding with Degree-Specific Neural Message Weights and RCQ Decoding

2023-10-24 · Linfang Wang, Caleb Terrill, Richard Wesel, Dariush Divsalar

Recently, neural networks have improved MinSum message-passing decoders for low-density parity-check (LDPC) codes by multiplying or adding weights to the messages, where the weights are determined by a neural network. Th…

DecoderQuantization

Message Passing Multi-Agent GANs

2016-12-05 · Arnab Ghosh, Viveka Kulharia, Vinay Namboodiri

Communicating and sharing intelligence among agents is an important facet of achieving Artificial General Intelligence. As a first step towards this challenge, we introduce a novel framework for image generation: Message…

Image Generation

Approximate Message Passing for Multi-Layer Estimation in Rotationally Invariant Models

2022-12-03 · Yizhou Xu, Tianqi Hou, Shansuo Liang, Marco Mondelli

We consider the problem of reconstructing the signal and the hidden variables from observations coming from a multi-layer network with rotationally invariant weight matrices. The multi-layer structure models inference fr…

Fast, Expressive SE$(n)$ Equivariant Networks through Weight-Sharing in Position-Orientation Space

2023-10-04 · Erik J Bekkers, Sharvaree Vadgama, Rob D Hesselink, Putri A van der Linden 외

Based on the theory of homogeneous spaces we derive geometrically optimal edge attributes to be used within the flexible message-passing framework. We formalize the notion of weight sharing in convolutional networks as t…

Computational EfficiencyPositionTrajectory Forecasting

A Theoretical Formulation of Many-body Message Passing Neural Networks

2024-07-16 · Jiatong Han

We present many-body Message Passing Neural Network (MPNN) framework that models higher-order node interactions ($\ge 2$ nodes). We model higher-order terms as tree-shaped motifs, comprising a central node with its neigh…

Sensitivity