paper-with-me

홈 › Papers

Improving Expressive Power of Spectral Graph Neural Networks with Eigenvalue Correction

2024-01-28 · Kangkang Lu, Yanhua Yu, Hao Fei, Xuan Li, Zixuan Yang, Zirui Guo, Meiyu Liang, Mengran Yin, Tat-Seng Chua

In recent years, spectral graph neural networks, characterized by polynomial filters, have garnered increasing attention and have achieved remarkable performance in tasks such as node classification. These models typically assume that eigenvalues for the normalized Laplacian matrix are distinct from each other, thus expecting a polynomial filter to have a high fitting ability. However, this paper empirically observes that normalized Laplacian matrices frequently possess repeated eigenvalues. Moreover, we theoretically establish that the number of distinguishable eigenvalues plays a pivotal role in determining the expressive power of spectral graph neural networks. In light of this observation, we propose an eigenvalue correction strategy that can free polynomial filters from the constraints of repeated eigenvalue inputs. Concretely, the proposed eigenvalue correction strategy enhances the uniform distribution of eigenvalues, thus mitigating repeated eigenvalues, and improving the fitting capacity and expressive power of polynomial filters. Extensive experimental results on both synthetic and real-world datasets demonstrate the superiority of our method. The code is available at: https://github.com/Lukangkang123/EC-GNN

📄 PDF Abstract BibTeX arXiv:2401.15603

Code (1)

lukangkang123/ec-gnn 공식 구현 pytorch

Tasks

Node Classification

Similar Papers 제목 키워드 기반

How Powerful are Spectral Graph Neural Networks

2022-05-23 · Xiyuan Wang, Muhan Zhang

Spectral Graph Neural Network is a kind of Graph Neural Network (GNN) based on graph signal filters. Some models able to learn arbitrary spectral filters have emerged recently. However, few works analyze the expressive p…

Graph Neural Network

Full-Spectrum Graph Neural Networks: Expressive and Scalable

2026-05-07 · Xiaohan Wang, Deyu Bo, Longlong Li, Kelin Xia arxiv

It is well established that spectral graph neural networks (GNNs) can universally approximate node signals; however, their expressive power remains bounded by the 1-dimensional Weisfeiler-Lehman test, which is mirrored i…

Graph Learning

Specformer: Spectral Graph Neural Networks Meet Transformers

2023-03-02 · Deyu Bo, Chuan Shi, Lele Wang, Renjie Liao

Spectral graph neural networks (GNNs) learn graph representations via spectral-domain graph convolutions. However, most existing spectral graph filters are scalar-to-scalar functions, i.e., mapping a single eigenvalue to…

Decoder

On the Expressive Power of Spectral Invariant Graph Neural Networks

2024-06-06 · Bohang Zhang, Lingxiao Zhao, Haggai Maron

Incorporating spectral information to enhance Graph Neural Networks (GNNs) has shown promising results but raises a fundamental challenge due to the inherent ambiguity of eigenvectors. Various architectures have been pro…

Breaking the Limits of Message Passing Graph Neural Networks

2021-06-08 · Muhammet Balcilar, Pierre Héroux, Benoit Gaüzère, Pascal Vasseur 외

Since the Message Passing (Graph) Neural Networks (MPNNs) have a linear complexity with respect to the number of nodes when applied to sparse graphs, they have been widely implemented and still raise a lot of interest ev…