Task-Adaptive Few-shot Node Classification

2022-06-23 · Song Wang, Kaize Ding, Chuxu Zhang, Chen Chen, Jundong Li

Node classification is of great importance among various graph mining tasks. In practice, real-world graphs generally follow the long-tail distribution, where a large number of classes only consist of limited labeled nodes. Although Graph Neural Networks (GNNs) have achieved significant improvements in node classification, their performance decreases substantially in such a few-shot scenario. The main reason can be attributed to the vast generalization gap between meta-training and meta-test due to the task variance caused by different node/class distributions in meta-tasks (i.e., node-level and class-level variance). Therefore, to effectively alleviate the impact of task variance, we propose a task-adaptive node classification framework under the few-shot learning setting. Specifically, we first accumulate meta-knowledge across classes with abundant labeled nodes. Then we transfer such knowledge to the classes with limited labeled nodes via our proposed task-adaptive modules. In particular, to accommodate the different node/class distributions among meta-tasks, we propose three essential modules to perform \emph{node-level}, \emph{class-level}, and \emph{task-level} adaptations in each meta-task, respectively. In this way, our framework can conduct adaptations to different meta-tasks and thus advance the model generalization performance on meta-test tasks. Extensive experiments on four prevalent node classification datasets demonstrate the superiority of our framework over the state-of-the-art baselines. Our code is provided at https://github.com/SongW-SW/TENT.

📄 PDF Abstract BibTeX arXiv:2206.11972

Code (1)

songw-sw/tent 공식 구현 pytorch

Tasks

Classification Few-Shot LearningGraph MiningNode Classification

Graph Few-shot Learning with Task-specific Structures

2022-10-21 · Song Wang, Chen Chen, Jundong Li

Graph few-shot learning is of great importance among various graph learning tasks. Under the few-shot scenario, models are often required to conduct classification given limited labeled samples. Existing graph few-shot l…

Classification Few-Shot Learning Graph Learning Node Classification

Graph Prototypical Networks for Few-shot Learning on Attributed Networks

2020-06-23 · Kaize Ding, Jianling Wang, Jundong Li, Kai Shu 외

Attributed networks nowadays are ubiquitous in a myriad of high-impact applications, such as social network analysis, financial fraud detection, and drug discovery. As a central analytical task on attributed networks, no…

Classification Drug Discovery Few-Shot Learning Fraud Detection+4

Inductive Linear Probing for Few-shot Node Classification

2023-06-14 · Hirthik Mathavan, Zhen Tan, Nivedh Mudiam, Huan Liu

Meta-learning has emerged as a powerful training strategy for few-shot node classification, demonstrating its effectiveness in the transductive setting. However, the existing literature predominantly focuses on transduct…

Classification Few-Shot Learning Meta-Learning Node Classification

Few-shot Node Classification with Extremely Weak Supervision

2023-01-06 · Song Wang, Yushun Dong, Kaize Ding, Chen Chen 외

Few-shot node classification aims at classifying nodes with limited labeled nodes as references. Recent few-shot node classification methods typically learn from classes with abundant labeled nodes (i.e., meta-training c…

Classification Meta-Learning Node Classification

Contrastive Meta-Learning for Few-shot Node Classification

2023-06-27 · Song Wang, Zhen Tan, Huan Liu, Jundong Li

Few-shot node classification, which aims to predict labels for nodes on graphs with only limited labeled nodes as references, is of great significance in real-world graph mining tasks. Particularly, in this paper, we ref…

Classification Graph Mining Meta-Learning Node Classification