paper-with-me

Papers

Flexible Diffusion Scopes with Parameterized Laplacian for Heterophilic Graph Learning

2024-09-15 · Qincheng Lu, Jiaqi Zhu, Sitao Luan, Xiao-Wen Chang

The ability of Graph Neural Networks (GNNs) to capture long-range and global topology information is limited by the scope of conventional graph Laplacian, leading to unsatisfactory performance on some datasets, particularly on heterophilic graphs. To address this limitation, we propose a new class of parameterized Laplacian matrices, which provably offers more flexibility in controlling the diffusion distance between nodes than the conventional graph Laplacian, allowing long-range information to be adaptively captured through diffusion on graph. Specifically, we first prove that the diffusion distance and spectral distance on graph have an order-preserving relationship. With this result, we demonstrate that the parameterized Laplacian can accelerate the diffusion of long-range information, and the parameters in the Laplacian enable flexibility of the diffusion scopes. Based on the theoretical results, we propose topology-guided rewiring mechanism to capture helpful long-range neighborhood information for heterophilic graphs. With this mechanism and the new Laplacian, we propose two GNNs with flexible diffusion scopes: namely the Parameterized Diffusion based Graph Convolutional Networks (PD-GCN) and Graph Attention Networks (PD-GAT). Synthetic experiments reveal the high correlations between the parameters of the new Laplacian and the performance of parameterized GNNs under various graph homophily levels, which verifies that our new proposed GNNs indeed have the ability to adjust the parameters to adaptively capture the global information for different levels of heterophilic graphs. They also outperform the state-of-the-art (SOTA) models on 6 out of 7 real-world benchmark datasets, which further confirms their superiority.

📄 PDF Abstract BibTeX arXiv:2409.09888

Code (0)

등록된 구현이 없습니다.

Tasks

Graph AttentionGraph Learning

Methods 이 논문이 사용한 방법론

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Attention 설명 없음
Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

Neural Sheaf Diffusion: A Topological Perspective on Heterophily and Oversmoothing in GNNs

2022-02-09 · Cristian Bodnar, Francesco Di Giovanni, Benjamin Paul Chamberlain, Pietro Liò 외

Cellular sheaves equip graphs with a "geometrical" structure by assigning vector spaces and linear maps to nodes and edges. Graph Neural Networks (GNNs) implicitly assume a graph with a trivial underlying sheaf. This cho…

Node ClassificationNode Classification on Non-Homophilic (Heterophilic) Graphs

p-Laplacian Transformer

2023-11-06 · Tuan Nguyen, Tam Nguyen, Vinh Nguyen, Tan M. Nguyen

$p$-Laplacian regularization, rooted in graph and image signal processing, introduces a parameter $p$ to control the regularization effect on these data. Smaller values of $p$ promote sparsity and interpretability, while…

Representation Learning on Heterophilic Graph with Directional Neighborhood Attention

2024-03-03 · Qincheng Lu, Jiaqi Zhu, Sitao Luan, Xiao-Wen Chang

Graph Attention Network (GAT) is one of the most popular Graph Neural Network (GNN) architecture, which employs the attention mechanism to learn edge weights and has demonstrated promising performance in various applicat…

Graph AttentionGraph Neural NetworkRepresentation Learning

Graph Adversarial Diffusion Convolution

2024-06-04 · Songtao Liu, Jinghui Chen, Tianfan Fu, Lu Lin 외

This paper introduces a min-max optimization formulation for the Graph Signal Denoising (GSD) problem. In this formulation, we first maximize the second term of GSD by introducing perturbations to the graph structure bas…

Denoising

Sheaf Neural Networks

2020-12-08 · NeurIPS Workshop TDA_and_Beyond 2020 12 · Jakob Hansen, Thomas Gebhart

We present a generalization of graph convolutional networks by generalizing the diffusion operation underlying this class of graph neural networks. These sheaf neural networks are based on the sheaf Laplacian, a generali…