Virtual Node Tuning for Few-shot Node Classification
Few-shot Node Classification (FSNC) is a challenge in graph representation learning where only a few labeled nodes per class are available for training. To tackle this issue, meta-learning has been proposed to transfer structural knowledge from base classes with abundant labels to target novel classes. However, existing solutions become ineffective or inapplicable when base classes have no or limited labeled nodes. To address this challenge, we propose an innovative method dubbed Virtual Node Tuning (VNT). Our approach utilizes a pretrained graph transformer as the encoder and injects virtual nodes as soft prompts in the embedding space, which can be optimized with few-shot labels in novel classes to modulate node embeddings for each specific FSNC task. A unique feature of VNT is that, by incorporating a Graph-based Pseudo Prompt Evolution (GPPE) module, VNT-GPPE can handle scenarios with sparse labels in base classes. Experimental results on four datasets demonstrate the superiority of the proposed approach in addressing FSNC with unlabeled or sparsely labeled base classes, outperforming existing state-of-the-art methods and even fully supervised baselines.
Code (0)
등록된 구현이 없습니다.
Tasks
ClassificationGraph Representation LearningMeta-LearningNode ClassificationRepresentation LearningMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Prompt Tuning without Labeled Samples for Zero-Shot Node Classification in Text-Attributed Graphs
Node classification is a fundamental problem in information retrieval with many real-world applications, such as community detection in social networks, grouping articles published online and product categorization in e-…
Product CategorizationInformation RetrievalNode ClassificationCommunity DetectionGraph Classification via Deep Learning with Virtual Nodes
Learning representation for graph classification turns a variable-size graph into a fixed-size vector (or matrix). Such a representation works nicely with algebraic manipulations. Here we introduce a simple method to aug…
ClassificationDeep LearningGeneral ClassificationGraph ClassificationRevisiting Virtual Nodes in Graph Neural Networks for Link Prediction
It is well known that the graph classification performance of graph neural networks often improves by adding an artificial virtual node to the graphs, which is connected to all nodes in the graph. Intuitively, the virtua…
ClusteringGraph ClassificationLink PredictionGraph Contrastive Learning Meets Graph Meta Learning: A Unified Method for Few-shot Node Tasks
Graph Neural Networks (GNNs) have become popular in Graph Representation Learning (GRL). One fundamental application is few-shot node classification. Most existing methods follow the meta learning paradigm, showing the a…
CoLAContrastive LearningGraph Representation LearningMeta-Learning+2Few-shot Node Classification with Extremely Weak Supervision
Few-shot node classification aims at classifying nodes with limited labeled nodes as references. Recent few-shot node classification methods typically learn from classes with abundant labeled nodes (i.e., meta-training c…
ClassificationMeta-LearningNode Classification