paper-with-me

홈 › Papers

LON-GNN: Spectral GNNs with Learnable Orthonormal Basis

2023-03-24 · Qian Tao, Zhen Wang, Wenyuan Yu, Yaliang Li, Zhewei Wei

In recent years, a plethora of spectral graph neural networks (GNN) methods have utilized polynomial basis with learnable coefficients to achieve top-tier performances on many node-level tasks. Although various kinds of polynomial bases have been explored, each such method adopts a fixed polynomial basis which might not be the optimal choice for the given graph. Besides, we identify the so-called over-passing issue of these methods and show that it is somewhat rooted in their less-principled regularization strategy and unnormalized basis. In this paper, we make the first attempts to address these two issues. Leveraging Jacobi polynomials, we design a novel spectral GNN, LON-GNN, with Learnable OrthoNormal bases and prove that regularizing coefficients becomes equivalent to regularizing the norm of learned filter function now. We conduct extensive experiments on diverse graph datasets to evaluate the fitting and generalization capability of LON-GNN, where the results imply its superiority.

📄 PDF Abstract BibTeX arXiv:2303.13750

Code (1)

taolbr1993/lon-gnn 공식 구현 pytorch

Similar Papers 제목 키워드 기반

ManifoldFlow: SPD-Relaxed Stiefel Layers with Learnable Singular Spectrum

2026-07-05 · Haiwen Yi, Xinyuan Song arxiv

Orthogonal and Stiefel layers give neural weights exact spectral control, but they also impose a strong modeling constraint: all represented singular values are fixed at one. Many settings that benefit from an orthonorma…

Fast Haar Transforms for Graph Neural Networks

2019-07-10 · Ming Li, Zheng Ma, Yu Guang Wang, Xiaosheng Zhuang

Graph Neural Networks (GNNs) have become a topic of intense research recently due to their powerful capability in high-dimensional classification and regression tasks for graph-structured data. However, as GNNs typically…

General ClassificationNode Classificationregression

Nonlinear Self-Interference Cancellation With Learnable Orthonormal Polynomials for Full-Duplex Wireless Systems

2024-03-17 · Hyowon Lee, Jungyeon Kim, Geon Choi, Ian P. Roberts 외

Nonlinear self-interference cancellation (SIC) is essential for full-duplex communication systems, which can offer twice the spectral efficiency of traditional half-duplex systems. The challenge of nonlinear SIC is simil…

Fast Machine Learning Method with Vector Embedding on Orthonormal Basis and Spectral Transform

2023-10-27 · Louis Yu Lu

This paper presents a novel fast machine learning method that leverages two techniques: Vector Embedding on Orthonormal Basis (VEOB) and Spectral Transform (ST). The VEOB converts the original data encoding into a vector…

Data Compression

Graph Neural Networks with Learnable and Optimal Polynomial Bases

2023-02-24 · Yuhe Guo, Zhewei Wei

Polynomial filters, a kind of Graph Neural Networks, typically use a predetermined polynomial basis and learn the coefficients from the training data. It has been observed that the effectiveness of the model is highly de…

Node ClassificationNode Classification on Non-Homophilic (Heterophilic) Graphs