paper-with-me

Papers

Polynomial Neural Sheaf Diffusion: A Spectral Filtering Approach on Cellular Sheaves

2025-11-28 · Alessio Borgi, Fabrizio Silvestri, Pietro Liò arxiv

Sheaf Neural Networks equip graph structures with a cellular sheaf: a geometric structure which assigns local vector spaces (stalks) and a linear learnable restriction/transport maps to nodes and edges, yielding an edge-aware inductive bias that handles heterophily and limits oversmoothing. However, common Neural Sheaf Diffusion implementations rely on SVD-based sheaf normalization and dense per-edge restriction maps, which scale with stalk dimension, require frequent Laplacian rebuilds, and yield brittle gradients. To address these limitations, we introduce Polynomial Neural Sheaf Diffusion (PolyNSD), a new sheaf diffusion approach whose propagation operator is a degree-K polynomial in a normalised sheaf Laplacian, evaluated via a stable three-term recurrence on a spectrally rescaled operator. This provides an explicit K-hop receptive field in a single layer (independently of the stalk dimension), with a trainable spectral response obtained as a convex mixture of K+1 orthogonal polynomial basis responses. PolyNSD enforces stability via convex mixtures, spectral rescaling, and residual/gated paths, reaching new state-of-the-art results on both homophilic and heterophilic benchmarks, inverting the Neural Sheaf Diffusion trend by obtaining these results with just diagonal restriction maps, decoupling performance from large stalk dimension, while reducing runtime and memory requirements.

📄 PDF Abstract BibTeX arXiv:2512.00242

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Sheaf Graph Neural Networks via PAC-Bayes Spectral Optimization

2025-08-01 · Yoonhyuk Choi, Jiho Choi, Chong-Kwon Kim arxiv

Over-smoothing in Graph Neural Networks (GNNs) causes collapse in distinct node features, particularly on heterophilic graphs where adjacent nodes often have dissimilar labels. Although sheaf neural networks partially mi…

Node Classification

Neural Sheaf Diffusion: A Topological Perspective on Heterophily and Oversmoothing in GNNs

2022-02-09 · Cristian Bodnar, Francesco Di Giovanni, Benjamin Paul Chamberlain, Pietro Liò 외

Cellular sheaves equip graphs with a "geometrical" structure by assigning vector spaces and linear maps to nodes and edges. Graph Neural Networks (GNNs) implicitly assume a graph with a trivial underlying sheaf. This cho…

Node ClassificationNode Classification on Non-Homophilic (Heterophilic) Graphs

A Hierarchical Sheaf Spectral Embedding Framework for Single-Cell RNA-seq Analysis

2026-03-27 · Xiang Xiang Wang, Guo-Wei We arxiv

Single-cell RNA-seq data analysis typically requires representations that capture heterogeneous local structure across multiple scales while remaining stable and interpretable. In this work, we propose a hierarchical she…

Representation Learning

Cooperative Sheaf Neural Networks

2025-07-01 · André Ribeiro, Ana Luiza Tenório, Juan Belieni, Amauri H. Souza 외 arxiv

Sheaf diffusion has recently emerged as a promising design pattern for graph representation learning due to its inherent ability to handle heterophilic data and avoid oversmoothing. Meanwhile, cooperative message passing…

Graph Representation Learning

Sheaf Cohomology of Linear Predictive Coding Networks

2025-11-14 · Jeffrey Seely arxiv

Predictive coding (PC) replaces global backpropagation with local optimization over weights and activations. We show that linear PC networks admit a natural formulation as cellular sheaves: the sheaf coboundary maps acti…