paper-with-me

Papers

Inductive Graph Few-shot Class Incremental Learning

2024-11-11 · Yayong Li, Peyman Moghadam, Can Peng, Nan Ye, Piotr Koniusz

Node classification with Graph Neural Networks (GNN) under a fixed set of labels is well known in contrast to Graph Few-Shot Class Incremental Learning (GFSCIL), which involves learning a GNN classifier as graph nodes and classes growing over time sporadically. We introduce inductive GFSCIL that continually learns novel classes with newly emerging nodes while maintaining performance on old classes without accessing previous data. This addresses the practical concern of transductive GFSCIL, which requires storing the entire graph with historical data. Compared to the transductive GFSCIL, the inductive setting exacerbates catastrophic forgetting due to inaccessible previous data during incremental training, in addition to overfitting issue caused by label sparsity. Thus, we propose a novel method, called Topology-based class Augmentation and Prototype calibration (TAP). To be specific, it first creates a triple-branch multi-topology class augmentation method to enhance model generalization ability. As each incremental session receives a disjoint subgraph with nodes of novel classes, the multi-topology class augmentation method helps replicate such a setting in the base session to boost backbone versatility. In incremental learning, given the limited number of novel class samples, we propose an iterative prototype calibration to improve the separation of class prototypes. Furthermore, as backbone fine-tuning poses the feature distribution drift, prototypes of old classes start failing over time, we propose the prototype shift method for old classes to compensate for the drift. We showcase the proposed method on four datasets.

📄 PDF Abstract BibTeX arXiv:2411.06634

Code (0)

등록된 구현이 없습니다.

Tasks

class-incremental learningClass Incremental LearningFew-Shot Class-Incremental LearningIncremental LearningNode Classification

Methods 이 논문이 사용한 방법론

BASE 설명 없음
SET Dynamic Sparse Training method where weight mask is updated randomly periodically

Similar Papers 제목 키워드 기반

Inductive Linear Probing for Few-shot Node Classification

2023-06-14 · Hirthik Mathavan, Zhen Tan, Nivedh Mudiam, Huan Liu

Meta-learning has emerged as a powerful training strategy for few-shot node classification, demonstrating its effectiveness in the transductive setting. However, the existing literature predominantly focuses on transduct…

ClassificationFew-Shot LearningMeta-LearningNode Classification

Towards Robust Graph Incremental Learning on Evolving Graphs

2024-02-20 · Junwei Su, Difan Zou, Zijun Zhang, Chuan Wu

Incremental learning is a machine learning approach that involves training a model on a sequence of tasks, rather than all tasks at once. This ability to learn incrementally from a stream of tasks is crucial for many rea…

Incremental Learning

Constructing Sample-to-Class Graph for Few-Shot Class-Incremental Learning

2023-10-31 · Fuyuan Hu, Jian Zhang, Fan Lyu, Linyan Li 외

Few-shot class-incremental learning (FSCIL) aims to build machine learning model that can continually learn new concepts from a few data samples, without forgetting knowledge of old classes. The challenges of FSCIL lies …

class-incremental learningClass Incremental LearningFew-Shot Class-Incremental LearningGraph Learning+1

Towards Few-shot Inductive Link Prediction on Knowledge Graphs: A Relational Anonymous Walk-guided Neural Process Approach

2023-06-26 · Zicheng Zhao, Linhao Luo, Shirui Pan, Quoc Viet Hung Nguyen 외

Few-shot inductive link prediction on knowledge graphs (KGs) aims to predict missing links for unseen entities with few-shot links observed. Previous methods are limited to transductive scenarios, where entities exist in…

Inductive Link PredictionKnowledge GraphsLink PredictionPrediction

Two-level Graph Network for Few-Shot Class-Incremental Learning

2023-03-24 · Hao Chen, Linyan Li, Fan Lyu, Fuyuan Hu 외

Few-shot class-incremental learning (FSCIL) aims to design machine learning algorithms that can continually learn new concepts from a few data points, without forgetting knowledge of old classes. The difficulty lies in t…

class-incremental learningClass Incremental LearningFew-Shot Class-Incremental LearningGraph Neural Network+2