paper-with-me

홈 › Papers

HGPROMPT: Bridging Homogeneous and Heterogeneous Graphs for Few-shot Prompt Learning

2023-12-04 · Xingtong Yu, Yuan Fang, Zemin Liu, Xinming Zhang

Graph neural networks (GNNs) and heterogeneous graph neural networks (HGNNs) are prominent techniques for homogeneous and heterogeneous graph representation learning, yet their performance in an end-to-end supervised framework greatly depends on the availability of task-specific supervision. To reduce the labeling cost, pre-training on self-supervised pretext tasks has become a popular paradigm,but there is often a gap between the pre-trained model and downstream tasks, stemming from the divergence in their objectives. To bridge the gap, prompt learning has risen as a promising direction especially in few-shot settings, without the need to fully fine-tune the pre-trained model. While there has been some early exploration of prompt-based learning on graphs, they primarily deal with homogeneous graphs, ignoring the heterogeneous graphs that are prevalent in downstream applications. In this paper, we propose HGPROMPT, a novel pre-training and prompting framework to unify not only pre-training and downstream tasks but also homogeneous and heterogeneous graphs via a dual-template design. Moreover, we propose dual-prompt in HGPROMPT to assist a downstream task in locating the most relevant prior to bridge the gaps caused by not only feature variations but also heterogeneity differences across tasks. Finally, we thoroughly evaluate and analyze HGPROMPT through extensive experiments on three public datasets.

📄 PDF Abstract BibTeX arXiv:2312.01878

Code (0)

등록된 구현이 없습니다.

Tasks

Graph Representation LearningPrompt LearningRepresentation Learning

Similar Papers 제목 키워드 기반

Unified Multi-Domain Graph Pre-training for Homogeneous and Heterogeneous Graphs via Domain-Specific Expert Encoding

2026-02-13 · Chundong Liang, Yongqi Huang, Dongxiao He, Peiyuan Li 외 arxiv

Graph pre-training has achieved remarkable success in recent years, delivering transferable representations for downstream adaptation. However, most existing methods are designed for either homogeneous or heterogeneous g…

SPAN: Subgraph Prediction Attention Network for Dynamic Graphs

2021-08-17 · Yuan Li, Chuanchang Chen, Yubo Tao, Hai Lin

This paper proposes a novel model for predicting subgraphs in dynamic graphs, an extension of traditional link prediction. This proposed end-to-end model learns a mapping from the subgraph structures in the current snaps…

AttributeLink PredictionPrediction

Enabling Homogeneous GNNs to Handle Heterogeneous Graphs via Relation Embedding

2022-09-23 · Junfu Wang, Yuanfang Guo, Liang Yang, Yunhong Wang

Graph Neural Networks (GNNs) have been generalized to process the heterogeneous graphs by various approaches. Unfortunately, these approaches usually model the heterogeneity via various complicated modules. This paper ai…

Graph LearningGraph Neural NetworkNode ClassificationRelation

Equivariant Heterogeneous Graph Networks

2021-09-29 · Daniel Levy, Siamak Ravanbakhsh

Many real-world datasets include multiple distinct types of entities and relations, and so they are naturally best represented by heterogeneous graphs. However, the most common forms of neural networks operating on graph…

Link PredictionNode Classification

HMSG: Heterogeneous Graph Neural Network based on Metapath Subgraph Learning

2021-09-07 · Xinjun Cai, Jiaxing Shang, Fei Hao, Dajiang Liu 외

Many real-world data can be represented as heterogeneous graphs with different types of nodes and connections. Heterogeneous graph neural network model aims to embed nodes or subgraphs into low-dimensional vector space f…

AttributeGraph Neural NetworkLink PredictionNode Classification+1