paper-with-me

홈 › Papers

Graph Neural Networks with Diverse Spectral Filtering

2023-12-14 · Jingwei Guo, Kaizhu Huang, Xinping Yi, Rui Zhang

Spectral Graph Neural Networks (GNNs) have achieved tremendous success in graph machine learning, with polynomial filters applied for graph convolutions, where all nodes share the identical filter weights to mine their local contexts. Despite the success, existing spectral GNNs usually fail to deal with complex networks (e.g., WWW) due to such homogeneous spectral filtering setting that ignores the regional heterogeneity as typically seen in real-world networks. To tackle this issue, we propose a novel diverse spectral filtering (DSF) framework, which automatically learns node-specific filter weights to exploit the varying local structure properly. Particularly, the diverse filter weights consist of two components -- A global one shared among all nodes, and a local one that varies along network edges to reflect node difference arising from distinct graph parts -- to balance between local and global information. As such, not only can the global graph characteristics be captured, but also the diverse local patterns can be mined with awareness of different node positions. Interestingly, we formulate a novel optimization problem to assist in learning diverse filters, which also enables us to enhance any spectral GNNs with our DSF framework. We showcase the proposed framework on three state-of-the-arts including GPR-GNN, BernNet, and JacobiConv. Extensive experiments over 10 benchmark datasets demonstrate that our framework can consistently boost model performance by up to 4.92% in node classification tasks, producing diverse filters with enhanced interpretability. Code is available at \url{https://github.com/jingweio/DSF}.

📄 PDF Abstract BibTeX arXiv:2312.09041

Code (1)

jingweio/dsf 공식 구현 pytorch

Tasks

GPRNode Classification

Similar Papers 제목 키워드 기반

Node-oriented Spectral Filtering for Graph Neural Networks

2022-12-07 · Shuai Zheng, Zhenfeng Zhu, Zhizhe Liu, Youru Li 외

Graph neural networks (GNNs) have shown remarkable performance on homophilic graph data while being far less impressive when handling non-homophilic graph data due to the inherent low-pass filtering property of GNNs. In …

Graph Neural NetworkNode Classification

Addressing Heterogeneity and Heterophily in Graphs: A Heterogeneous Heterophilic Spectral Graph Neural Network

2024-10-17 · Kangkang Lu, Yanhua Yu, Zhiyong Huang, Jia Li 외

Graph Neural Networks (GNNs) have garnered significant scholarly attention for their powerful capabilities in modeling graph structures. Despite this, two primary challenges persist: heterogeneity and heterophily. Existi…

Graph Neural Network

Graph Spectral Filtering with Chebyshev Interpolation for Recommendation

2025-05-01 · Chanwoo Kim, Jinkyu Sung, Yebonn Han, Joonseok Lee

Graph convolutional networks have recently gained prominence in collaborative filtering (CF) for recommendations. However, we identify potential bottlenecks in two foundational components. First, the embedding layer lead…

Collaborative Filtering

Quasi-Framelets: Robust Graph Neural Networks via Adaptive Framelet Convolution

2022-01-11 · Mengxi Yang, Dai Shi, Xuebin Zheng, Jie Yin 외

This paper aims to provide a novel design of a multiscale framelet convolution for spectral graph neural networks (GNNs). While current spectral methods excel in various graph learning tasks, they often lack the flexibil…

Graph LearningGraph Neural NetworkNode Classification

Rethinking Spectral Graph Neural Networks with Spatially Adaptive Filtering

2024-01-17 · Jingwei Guo, Kaizhu Huang, Xinping Yi, Zixian Su 외

Whilst spectral Graph Neural Networks (GNNs) are theoretically well-founded in the spectral domain, their practical reliance on polynomial approximation implies a profound linkage to the spatial domain. As previous studi…

Node Classification