paper-with-me

홈 › Papers

Improving Graph Neural Networks with Learnable Propagation Operators

2022-10-31 · Moshe Eliasof, Lars Ruthotto, Eran Treister

Graph Neural Networks (GNNs) are limited in their propagation operators. In many cases, these operators often contain non-negative elements only and are shared across channels, limiting the expressiveness of GNNs. Moreover, some GNNs suffer from over-smoothing, limiting their depth. On the other hand, Convolutional Neural Networks (CNNs) can learn diverse propagation filters, and phenomena like over-smoothing are typically not apparent in CNNs. In this paper, we bridge these gaps by incorporating trainable channel-wise weighting factors $\omega$ to learn and mix multiple smoothing and sharpening propagation operators at each layer. Our generic method is called $\omega$GNN, and is easy to implement. We study two variants: $\omega$GCN and $\omega$GAT. For $\omega$GCN, we theoretically analyse its behaviour and the impact of $\omega$ on the obtained node features. Our experiments confirm these findings, demonstrating and explaining how both variants do not over-smooth. Additionally, we experiment with 15 real-world datasets on node- and graph-classification tasks, where our $\omega$GCN and $\omega$GAT perform on par with state-of-the-art methods.

📄 PDF Abstract BibTeX arXiv:2210.17224

Code (0)

등록된 구현이 없습니다.

Tasks

Graph Classification

Similar Papers 제목 키워드 기반

Context-guided diffusion for label propagation on graphs

2016-02-20 · ICCV 2015 12 · Kwang In Kim, James Tompkin, Hanspeter Pfister, Christian Theobalt

Existing approaches for diffusion on graphs, e.g., for label propagation, are mainly focused on isotropic diffusion, which is induced by the commonly-used graph Laplacian regularizer. Inspired by the success of diffusivi…

A Generalized Tikhonov Layer for Interpretable-by-design Graph Neural Networks

2026-05-27 · Nicolas Tremblay, Benjamin Ricaud, Filippo Maria Bianchi arxiv

We propose the Tikhonov layer, a graph neural network layer that is interpretable by design: once trained, its learned parameters directly reveal which node features and which aspects of the graph topology were leveraged…

Graph ClassificationGraph Neural Network

Spherical CNNs on Unstructured Grids

2019-01-07 · ICLR 2019 5 · Chiyu "Max" Jiang, Jingwei Huang, Karthik Kashinath, Prabhat 외

We present an efficient convolution kernel for Convolutional Neural Networks (CNNs) on unstructured grids using parameterized differential operators while focusing on spherical signals such as panorama images or planetar…

Semantic Segmentation

Revisiting Pre-Propagation GNNs: Robust Diffusion Operators and Hidden-State Re-Propagation

2026-05-24 · Zichao Yue, Zhiru Zhang arxiv

Pre-propagation graph neural networks (PPGNNs) decouple node feature propagation from transformation: graph diffusion is performed once as preprocessing, and training reduces to dense per-node transformations. This desig…

Collapsing Taylor Mode Automatic Differentiation

2025-05-19 · Felix Dangel, Tim Siebert, Marius Zeinhofer, Andrea Walther

Computing partial differential equation (PDE) operators via nested backpropagation is expensive, yet popular, and severely restricts their utility for scientific machine learning. Recent advances, like the forward Laplac…