Geometer: Graph Few-Shot Class-Incremental Learning via Prototype Representation
With the tremendous expansion of graphs data, node classification shows its great importance in many real-world applications. Existing graph neural network based methods mainly focus on classifying unlabeled nodes within fixed classes with abundant labeling. However, in many practical scenarios, graph evolves with emergence of new nodes and edges. Novel classes appear incrementally along with few labeling due to its newly emergence or lack of exploration. In this paper, we focus on this challenging but practical graph few-shot class-incremental learning (GFSCIL) problem and propose a novel method called Geometer. Instead of replacing and retraining the fully connected neural network classifer, Geometer predicts the label of a node by finding the nearest class prototype. Prototype is a vector representing a class in the metric space. With the pop-up of novel classes, Geometer learns and adjusts the attention-based prototypes by observing the geometric proximity, uniformity and separability. Teacher-student knowledge distillation and biased sampling are further introduced to mitigate catastrophic forgetting and unbalanced labeling problem respectively. Experimental results on four public datasets demonstrate that Geometer achieves a substantial improvement of 9.46% to 27.60% over state-of-the-art methods.
Code (1)
Tasks
class-incremental learningClass Incremental LearningFew-Shot Class-Incremental LearningGraph Neural NetworkIncremental LearningKnowledge DistillationNode ClassificationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Inductive Graph Few-shot Class Incremental Learning
Node classification with Graph Neural Networks (GNN) under a fixed set of labels is well known in contrast to Graph Few-Shot Class Incremental Learning (GFSCIL), which involves learning a GNN classifier as graph nodes an…
class-incremental learningClass Incremental LearningFew-Shot Class-Incremental LearningIncremental Learning+1Prototype-based Incremental Few-Shot Semantic Segmentation
Semantic segmentation models have two fundamental weaknesses: i) they require large training sets with costly pixel-level annotations, and ii) they have a static output space, constrained to the classes of the training s…
Few-Shot Semantic SegmentationIncremental LearningKnowledge DistillationSegmentation+1Graph Few-shot Class-incremental Learning
The ability to incrementally learn new classes is vital to all real-world artificial intelligence systems. A large portion of high-impact applications like social media, recommendation systems, E-commerce platforms, etc.…
class-incremental learningClass Incremental LearningFew-Shot Class-Incremental LearningIncremental Learning+2An Efficient Memory Module for Graph Few-Shot Class-Incremental Learning
Incremental graph learning has gained significant attention for its ability to address the catastrophic forgetting problem in graph representation learning. However, traditional methods often rely on a large number of la…
class-incremental learningClass Incremental LearningFew-Shot Class-Incremental LearningGraph Learning+6Task Consistent Prototype Learning for Incremental Few-shot Semantic Segmentation
Incremental Few-Shot Semantic Segmentation (iFSS) tackles a task that requires a model to continually expand its segmentation capability on novel classes using only a few annotated examples. Typical incremental approache…
Few-Shot Semantic SegmentationIncremental LearningMeta-LearningSemantic Segmentation