paper-with-me

홈 › Papers

Non-Homophilic Graph Pre-Training and Prompt Learning

2024-08-22 · Xingtong Yu, Jie Zhang, Yuan Fang, Renhe Jiang

Graphs are ubiquitous for modeling complex relationships between objects across various fields. Graph neural networks (GNNs) have become a mainstream technique for graph-based applications, but their performance heavily relies on abundant labeled data. To reduce labeling requirement, pre-training and prompt learning has become a popular alternative. However, most existing prompt methods do not differentiate homophilic and heterophilic characteristics of real-world graphs. In particular, many real-world graphs are non-homophilic, not strictly or uniformly homophilic with mixing homophilic and heterophilic patterns, exhibiting varying non-homophilic characteristics across graphs and nodes. In this paper, we propose ProNoG, a novel pre-training and prompt learning framework for such non-homophilic graphs. First, we analyze existing graph pre-training methods, providing theoretical insights into the choice of pre-training tasks. Second, recognizing that each node exhibits unique non-homophilic characteristics, we propose a conditional network to characterize the node-specific patterns in downstream tasks. Finally, we thoroughly evaluate and analyze ProNoG through extensive experiments on ten public datasets.

📄 PDF Abstract BibTeX arXiv:2408.12594

Code (1)

jaygagaga/pronog 공식 구현 pytorch

Tasks

Prompt Learning

Similar Papers 제목 키워드 기반

Demystifying Structural Disparity in Graph Neural Networks: Can One Size Fit All?

2023-06-02 · NeurIPS 2023 11 · Haitao Mao, Zhikai Chen, Wei Jin, Haoyu Han 외

Recent studies on Graph Neural Networks(GNNs) provide both empirical and theoretical evidence supporting their effectiveness in capturing structural patterns on both homophilic and certain heterophilic graphs. Notably, m…

AllNode Classification

HC-GST: Heterophily-aware Distribution Consistency based Graph Self-training

2024-07-25 · Fali Wang, Tianxiang Zhao, Junjie Xu, Suhang Wang

Graph self-training (GST), which selects and assigns pseudo-labels to unlabeled nodes, is popular for tackling label sparsity in graphs. However, recent study on homophily graphs show that GST methods could introduce and…

Restructuring Graph for Higher Homophily via Adaptive Spectral Clustering

2022-06-06 · Shouheng Li, Dongwoo Kim, Qing Wang

While a growing body of literature has been studying new Graph Neural Networks (GNNs) that work on both homophilic and heterophilic graphs, little has been done on adapting classical GNNs to less-homophilic graphs. Altho…

ClusteringNode Classification

Imbalanced Node Classification Beyond Homophilic Assumption

2023-04-28 · Jie Liu, Mengting He, Guangtao Wang, Nguyen Quoc Viet Hung 외

Imbalanced node classification widely exists in real-world networks where graph neural networks (GNNs) are usually highly inclined to majority classes and suffer from severe performance degradation on classifying minorit…

ClassificationNode Classification

Provable Filter for Real-world Graph Clustering

2024-03-06 · Xuanting Xie, Erlin Pan, Zhao Kang, Wenyu Chen 외

Graph clustering, an important unsupervised problem, has been shown to be more resistant to advances in Graph Neural Networks (GNNs). In addition, almost all clustering methods focus on homophilic graphs and ignore heter…

ClusteringGraph Clustering