paper-with-me

Papers

Geometer: Graph Few-Shot Class-Incremental Learning via Prototype Representation

2022-05-27 · Bin Lu, Xiaoying Gan, Lina Yang, Weinan Zhang, Luoyi Fu, Xinbing Wang

With the tremendous expansion of graphs data, node classification shows its great importance in many real-world applications. Existing graph neural network based methods mainly focus on classifying unlabeled nodes within fixed classes with abundant labeling. However, in many practical scenarios, graph evolves with emergence of new nodes and edges. Novel classes appear incrementally along with few labeling due to its newly emergence or lack of exploration. In this paper, we focus on this challenging but practical graph few-shot class-incremental learning (GFSCIL) problem and propose a novel method called Geometer. Instead of replacing and retraining the fully connected neural network classifer, Geometer predicts the label of a node by finding the nearest class prototype. Prototype is a vector representing a class in the metric space. With the pop-up of novel classes, Geometer learns and adjusts the attention-based prototypes by observing the geometric proximity, uniformity and separability. Teacher-student knowledge distillation and biased sampling are further introduced to mitigate catastrophic forgetting and unbalanced labeling problem respectively. Experimental results on four public datasets demonstrate that Geometer achieves a substantial improvement of 9.46% to 27.60% over state-of-the-art methods.

📄 PDF Abstract BibTeX arXiv:2205.13954

Code (1)

RobinLu1209/Geometer 공식 구현 pytorch

Tasks

class-incremental learningClass Incremental LearningFew-Shot Class-Incremental LearningGraph Neural NetworkIncremental LearningKnowledge DistillationNode Classification

Methods 이 논문이 사용한 방법론

Graph Neural Network 설명 없음
Knowledge Distillation A very simple way to improve the performance of almost any machine learning algorithm is to train many different models on the same data and then to average their predictions.…

Similar Papers 제목 키워드 기반

Inductive Graph Few-shot Class Incremental Learning

2024-11-11 · Yayong Li, Peyman Moghadam, Can Peng, Nan Ye 외

Node classification with Graph Neural Networks (GNN) under a fixed set of labels is well known in contrast to Graph Few-Shot Class Incremental Learning (GFSCIL), which involves learning a GNN classifier as graph nodes an…

class-incremental learningClass Incremental LearningFew-Shot Class-Incremental LearningIncremental Learning+1

Prototype-based Incremental Few-Shot Semantic Segmentation

2020-11-30 · Fabio Cermelli, Massimiliano Mancini, Yongqin Xian, Zeynep Akata 외

Semantic segmentation models have two fundamental weaknesses: i) they require large training sets with costly pixel-level annotations, and ii) they have a static output space, constrained to the classes of the training s…

Few-Shot Semantic SegmentationIncremental LearningKnowledge DistillationSegmentation+1

Graph Few-shot Class-incremental Learning

2021-12-23 · Zhen Tan, Kaize Ding, Ruocheng Guo, Huan Liu

The ability to incrementally learn new classes is vital to all real-world artificial intelligence systems. A large portion of high-impact applications like social media, recommendation systems, E-commerce platforms, etc.…

class-incremental learningClass Incremental LearningFew-Shot Class-Incremental LearningIncremental Learning+2

An Efficient Memory Module for Graph Few-Shot Class-Incremental Learning

2024-11-11 · Dong Li, Aijia Zhang, Junqi Gao, Biqing Qi

Incremental graph learning has gained significant attention for its ability to address the catastrophic forgetting problem in graph representation learning. However, traditional methods often rely on a large number of la…

class-incremental learningClass Incremental LearningFew-Shot Class-Incremental LearningGraph Learning+6

Task Consistent Prototype Learning for Incremental Few-shot Semantic Segmentation

2024-10-16 · Wenbo Xu, Yanan Wu, Haoran Jiang, Yang Wang 외

Incremental Few-Shot Semantic Segmentation (iFSS) tackles a task that requires a model to continually expand its segmentation capability on novel classes using only a few annotated examples. Typical incremental approache…

Few-Shot Semantic SegmentationIncremental LearningMeta-LearningSemantic Segmentation