paper-with-me

홈 › Papers

Polynomial Selection in Spectral Graph Neural Networks: An Error-Sum of Function Slices Approach

2024-04-15 · Guoming Li, Jian Yang, Shangsong Liang, Dongsheng Luo

Spectral graph neural networks are proposed to harness spectral information inherent in graph-structured data through the application of polynomial-defined graph filters, recently achieving notable success in graph-based web applications. Existing studies reveal that various polynomial choices greatly impact spectral GNN performance, underscoring the importance of polynomial selection. However, this selection process remains a critical and unresolved challenge. Although prior work suggests a connection between the approximation capabilities of polynomials and the efficacy of spectral GNNs, there is a lack of theoretical insights into this relationship, rendering polynomial selection a largely heuristic process. To address the issue, this paper examines polynomial selection from an error-sum of function slices perspective. Inspired by the conventional signal decomposition, we represent graph filters as a sum of disjoint function slices. Building on this, we then bridge the polynomial capability and spectral GNN efficacy by proving that the construction error of graph convolution layer is bounded by the sum of polynomial approximation errors on function slices. This result leads us to develop an advanced filter based on trigonometric polynomials, a widely adopted option for approximating narrow signal slices. The proposed filter remains provable parameter efficiency, with a novel Taylor-based parameter decomposition that achieves streamlined, effective implementation. With this foundation, we propose TFGNN, a scalable spectral GNN operating in a decoupled paradigm. We validate the efficacy of TFGNN via benchmark node classification tasks, along with an example graph anomaly detection application to show its practical utility.

📄 PDF Abstract BibTeX arXiv:2404.15354

Code (1)

vasile-paskardlgm/tfgnn 공식 구현 pytorch

Tasks

Anomaly DetectionGraph Anomaly DetectionGraph LearningNode Classification

Methods 이 논문이 사용한 방법론

Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…

Similar Papers 제목 키워드 기반

From ChebNet to ChebGibbsNet

2024-12-02 · Jie Zhang, Min-Te Sun

Recent advancements in Spectral Graph Convolutional Networks (SpecGCNs) have led to state-of-the-art performance in various graph representation learning tasks. To exploit the potential of SpecGCNs, we analyze correspond…

Graph Representation LearningNode ClassificationRepresentation Learning

Convolutional Neural Networks on Graphs with Chebyshev Approximation, Revisited

2022-02-04 · Mingguo He, Zhewei Wei, Ji-Rong Wen

Designing spectral convolutional networks is a challenging problem in graph learning. ChebNet, one of the early attempts, approximates the spectral graph convolutions using Chebyshev polynomials. GCN simplifies ChebNet b…

GPRGraph LearningNode Classification

PowerNet: Efficient Representations of Polynomials and Smooth Functions by Deep Neural Networks with Rectified Power Units

2019-09-09 · Bo Li, Shanshan Tang, Haijun Yu

Deep neural network with rectified linear units (ReLU) is getting more and more popular recently. However, the derivatives of the function represented by a ReLU network are not continuous, which limit the usage of ReLU n…

LON-GNN: Spectral GNNs with Learnable Orthonormal Basis

2023-03-24 · Qian Tao, Zhen Wang, Wenyuan Yu, Yaliang Li 외

In recent years, a plethora of spectral graph neural networks (GNN) methods have utilized polynomial basis with learnable coefficients to achieve top-tier performances on many node-level tasks. Although various kinds of …

Gaussian Processes on Graphs via Spectral Kernel Learning

2020-06-12 · Yin-Cong Zhi, Yin Cheng Ng, Xiaowen Dong

We propose a graph spectrum-based Gaussian process for prediction of signals defined on nodes of the graph. The model is designed to capture various graph signal structures through a highly adaptive kernel that incorpora…

Gaussian Processes