paper-with-me

홈 › Papers

Federated Spectral Graph Transformers Meet Neural Ordinary Differential Equations for Non-IID Graphs

2025-04-16 · Kishan Gurumurthy, Himanshu Pal, Charu Sharma

Graph Neural Network (GNN) research is rapidly advancing due to GNNs' capacity to learn distributed representations from graph-structured data. However, centralizing large volumes of real-world graph data for GNN training is often impractical due to privacy concerns, regulatory restrictions, and commercial competition. Federated learning (FL), a distributed learning paradigm, offers a solution by preserving data privacy with collaborative model training. Despite progress in training huge vision and language models, federated learning for GNNs remains underexplored. To address this challenge, we present a novel method for federated learning on GNNs based on spectral GNNs equipped with neural ordinary differential equations (ODE) for better information capture, showing promising results across both homophilic and heterophilic graphs. Our approach effectively handles non-Independent and Identically Distributed (non-IID) data, while also achieving performance comparable to existing methods that only operate on IID data. It is designed to be privacy-preserving and bandwidth-optimized, making it suitable for real-world applications such as social network analysis, recommendation systems, and fraud detection, which often involve complex, non-IID, and heterophilic graph structures. Our results in the area of federated learning on non-IID heterophilic graphs demonstrate significant improvements, while also achieving better performance on homophilic graphs. This work highlights the potential of federated learning in diverse and challenging graph settings. Open-source code available on GitHub (https://github.com/SpringWiz11/Fed-GNODEFormer).

📄 PDF Abstract BibTeX arXiv:2504.11808

Code (1)

springwiz11/fed-gnodeformer 공식 구현 pytorch

Tasks

Federated LearningFraud DetectionGraph Neural NetworkPrivacy PreservingRecommendation Systems

Similar Papers 제목 키워드 기반

Specformer: Spectral Graph Neural Networks Meet Transformers

2023-03-02 · Deyu Bo, Chuan Shi, Lele Wang, Renjie Liao

Spectral graph neural networks (GNNs) learn graph representations via spectral-domain graph convolutions. However, most existing spectral graph filters are scalar-to-scalar functions, i.e., mapping a single eigenvalue to…

Decoder

S2FGL: Spatial Spectral Federated Graph Learning

2025-07-03 · Zihan Tan, Suyuan Huang, Guancheng Wan, Wenke Huang 외

Federated Graph Learning (FGL) combines the privacy-preserving capabilities of federated learning (FL) with the strong graph modeling capability of Graph Neural Networks (GNNs). Current research addresses subgraph-FL onl…

Federated LearningGraph LearningPrivacy Preserving

Learning Exhaustive Correlation for Spectral Super-Resolution: Where Spatial-Spectral Attention Meets Linear Dependence

2023-12-20 · Hongyuan Wang, Lizhi Wang, Jiang Xu, Chang Chen 외

Spectral super-resolution that aims to recover hyperspectral image (HSI) from easily obtainable RGB image has drawn increasing interest in the field of computational photography. The crucial aspect of spectral super-reso…

Spectral Super-ResolutionSuper-Resolution

Transformers Don't In-Context Learn Least Squares Regression

2025-07-13 · Joshua Hill, Benjamin Eyre, Elliot Creager arxiv

In-context learning (ICL) has emerged as a powerful capability of large pretrained transformers, enabling them to solve new tasks implicit in example input-output pairs without any gradient updates. Despite its practical…

Heterogeneity-Aware Knowledge Sharing for Graph Federated Learning

2026-01-29 · Wentao Yu, Sheng Wan, Shuo Chen, Bo Han 외 arxiv

Graph Federated Learning (GFL) enables distributed graph representation learning while protecting the privacy of graph data. However, GFL suffers from heterogeneity arising from diverse node features and structural topol…

Graph Representation LearningFederated Learning