A Survey of Few-Shot Learning on Graphs: from Meta-Learning to Pre-Training and Prompt Learning
Graph representation learning, a critical step in graph-centric tasks, has seen significant advancements. Earlier techniques often operate in an end-to-end setting, which heavily rely on the availability of ample labeled data. This constraint has spurred the emergence of few-shot learning on graphs, where only a few labels are available for each task. Given the extensive literature in this field, this survey endeavors to synthesize recent developments, provide comparative insights, and identify future directions. We systematically categorize existing studies based on two major taxonomies: (1) Problem taxonomy, which explores different types of data scarcity problems and their applications, and (2) Technique taxonomy, which details key strategies for addressing these data-scarce few-shot problems. The techniques can be broadly categorized into meta-learning, pre-training, and hybrid approaches, with a finer-grained classification in each category to aid readers in their method selection process. Within each category, we analyze the relationships among these methods and compare their strengths and limitations. Finally, we outline prospective directions for few-shot learning on graphs to catalyze continued innovation in this field. The website for this survey can be accessed by \url{https://github.com/smufang/fewshotgraph}.
Code (1)
Tasks
Few-Shot LearningGraph Representation LearningMeta-LearningPrompt LearningRepresentation LearningSurveySimilar Papers 제목 키워드 기반
Exploring Graph Classification Techniques Under Low Data Constraints: A Comprehensive Study
This survey paper presents a brief overview of recent research on graph data augmentation and few-shot learning. It covers various techniques for graph data augmentation, including node and edge perturbation, graph coars…
Data AugmentationFew-Shot LearningGraph ClassificationGraph Generation+2Self-supervised Meta-Prompt Learning with Meta-Gradient Regularization for Few-shot Generalization
Prompt tuning is a parameter-efficient method, which learns soft prompts and conditions frozen language models to perform specific downstream tasks. Though effective, prompt tuning under few-shot settings on the one hand…
Domain GeneralizationFew-Shot LearningMeta-LearningPrompt LearningFAITH: Few-Shot Graph Classification with Hierarchical Task Graphs
Few-shot graph classification aims at predicting classes for graphs, given limited labeled graphs for each class. To tackle the bottleneck of label scarcity, recent works propose to incorporate few-shot learning framewor…
ClassificationFew-Shot LearningGraph ClassificationA Survey of Graph Prompting Methods: Techniques, Applications, and Challenges
The recent "pre-train, prompt, predict training" paradigm has gained popularity as a way to learn generalizable models with limited labeled data. The approach involves using a pre-trained model and a prompting function t…
Prompt LearningSurveyUnderstanding Survey Paper Taxonomy about Large Language Models via Graph Representation Learning
As new research on Large Language Models (LLMs) continues, it is difficult to keep up with new research and models. To help researchers synthesize the new research many have written survey papers, but even those have bec…
Graph Representation LearningRepresentation LearningSurvey