paper-with-me

홈 › Papers

Virtual Node Tuning for Few-shot Node Classification

2023-06-09 · Zhen Tan, Ruocheng Guo, Kaize Ding, Huan Liu

Few-shot Node Classification (FSNC) is a challenge in graph representation learning where only a few labeled nodes per class are available for training. To tackle this issue, meta-learning has been proposed to transfer structural knowledge from base classes with abundant labels to target novel classes. However, existing solutions become ineffective or inapplicable when base classes have no or limited labeled nodes. To address this challenge, we propose an innovative method dubbed Virtual Node Tuning (VNT). Our approach utilizes a pretrained graph transformer as the encoder and injects virtual nodes as soft prompts in the embedding space, which can be optimized with few-shot labels in novel classes to modulate node embeddings for each specific FSNC task. A unique feature of VNT is that, by incorporating a Graph-based Pseudo Prompt Evolution (GPPE) module, VNT-GPPE can handle scenarios with sparse labels in base classes. Experimental results on four datasets demonstrate the superiority of the proposed approach in addressing FSNC with unlabeled or sparsely labeled base classes, outperforming existing state-of-the-art methods and even fully supervised baselines.

📄 PDF Abstract BibTeX arXiv:2306.06063

Code (0)

등록된 구현이 없습니다.

Tasks

ClassificationGraph Representation LearningMeta-LearningNode ClassificationRepresentation Learning

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
LapEigen 설명 없음
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
Laplacian PE Laplacian eigenvectors represent a natural generalization of the…
Attention 설명 없음
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.

Similar Papers 제목 키워드 기반

Prompt Tuning without Labeled Samples for Zero-Shot Node Classification in Text-Attributed Graphs

2026-01-07 · Sethupathy Parameswaran, Suresh Sundaram, Yuan Fang arxiv

Node classification is a fundamental problem in information retrieval with many real-world applications, such as community detection in social networks, grouping articles published online and product categorization in e-…

Product CategorizationInformation RetrievalNode ClassificationCommunity Detection

Graph Classification via Deep Learning with Virtual Nodes

2017-08-14 · Trang Pham, Truyen Tran, Hoa Dam, Svetha Venkatesh

Learning representation for graph classification turns a variable-size graph into a fixed-size vector (or matrix). Such a representation works nicely with algebraic manipulations. Here we introduce a simple method to aug…

ClassificationDeep LearningGeneral ClassificationGraph Classification

Revisiting Virtual Nodes in Graph Neural Networks for Link Prediction

2021-09-29 · EunJeong Hwang, Veronika Thost, Shib Sankar Dasgupta, Tengfei Ma

It is well known that the graph classification performance of graph neural networks often improves by adding an artificial virtual node to the graphs, which is connected to all nodes in the graph. Intuitively, the virtua…

ClusteringGraph ClassificationLink Prediction

Graph Contrastive Learning Meets Graph Meta Learning: A Unified Method for Few-shot Node Tasks

2023-09-19 · Hao liu, Jiarui Feng, Lecheng Kong, DaCheng Tao 외

Graph Neural Networks (GNNs) have become popular in Graph Representation Learning (GRL). One fundamental application is few-shot node classification. Most existing methods follow the meta learning paradigm, showing the a…

CoLAContrastive LearningGraph Representation LearningMeta-Learning+2

Few-shot Node Classification with Extremely Weak Supervision

2023-01-06 · Song Wang, Yushun Dong, Kaize Ding, Chen Chen 외

Few-shot node classification aims at classifying nodes with limited labeled nodes as references. Recent few-shot node classification methods typically learn from classes with abundant labeled nodes (i.e., meta-training c…

ClassificationMeta-LearningNode Classification