Few-Shot Class-Incremental Learning with Prior Knowledge

2024-02-02 · Wenhao Jiang, Duo Li, Menghan Hu, Guangtao Zhai, Xiaokang Yang, Xiao-Ping Zhang

To tackle the issues of catastrophic forgetting and overfitting in few-shot class-incremental learning (FSCIL), previous work has primarily concentrated on preserving the memory of old knowledge during the incremental phase. The role of pre-trained model in shaping the effectiveness of incremental learning is frequently underestimated in these studies. Therefore, to enhance the generalization ability of the pre-trained model, we propose Learning with Prior Knowledge (LwPK) by introducing nearly free prior knowledge from a few unlabeled data of subsequent incremental classes. We cluster unlabeled incremental class samples to produce pseudo-labels, then jointly train these with labeled base class samples, effectively allocating embedding space for both old and new class data. Experimental results indicate that LwPK effectively enhances the model resilience against catastrophic forgetting, with theoretical analysis based on empirical risk minimization and class distance measurement corroborating its operational principles. The source code of LwPK is publicly available at: \url{https://github.com/StevenJ308/LwPK}.

📄 PDF Abstract BibTeX arXiv:2402.01201

Code (0)

등록된 구현이 없습니다.

Tasks

class-incremental learning Class Incremental Learning Few-Shot Class-Incremental Learning Incremental Learning

Methods 이 논문이 사용한 방법론

BASE 설명 없음

Incremental-DETR: Incremental Few-Shot Object Detection via Self-Supervised Learning

2022-05-09 · Na Dong, Yongqiang Zhang, Mingli Ding, Gim Hee Lee

Incremental few-shot object detection aims at detecting novel classes without forgetting knowledge of the base classes with only a few labeled training data from the novel classes. Most related prior works are on increme…

Few-Shot Object Detection Knowledge Distillation Object object-detection+2

PKI: Prior Knowledge-Infused Neural Network for Few-Shot Class-Incremental Learning

2026-01-13 · Kexin Baoa, Fanzhao Lin, Zichen Wang, Yong Li 외 arxiv

Few-shot class-incremental learning (FSCIL) aims to continually adapt a model on a limited number of new-class examples, facing two well-known challenges: catastrophic forgetting and overfitting to new classes. Existing …

Few-Shot Class-Incremental Learning

Pre-trained Vision and Language Transformers Are Few-Shot Incremental Learners

2024-04-02 · CVPR 2024 1 · Keon-Hee Park, Kyungwoo Song, Gyeong-Moon Park

Few-Shot Class Incremental Learning (FSCIL) is a task that requires a model to learn new classes incrementally without forgetting when only a few samples for each class are given. FSCIL encounters two significant challen…

class-incremental learning Class Incremental Learning Few-Shot Class-Incremental Learning Incremental Learning+2

Knowledge Transfer-Driven Few-Shot Class-Incremental Learning

2023-06-19 · Ye Wang, Yaxiong Wang, Guoshuai Zhao, Xueming Qian

Few-shot class-incremental learning (FSCIL) aims to continually learn new classes using a few samples while not forgetting the old classes. The key of this task is effective knowledge transfer from the base session to th…

class-incremental learning Class Incremental Learning Few-Shot Class-Incremental Learning Incremental Learning+1

XtarNet: Learning to Extract Task-Adaptive Representation for Incremental Few-Shot Learning

2020-03-19 · ICML 2020 1 · Sung Whan Yoon, Do-Yeon Kim, Jun Seo, Jaekyun Moon

Learning novel concepts while preserving prior knowledge is a long-standing challenge in machine learning. The challenge gets greater when a novel task is given with only a few labeled examples, a problem known as increm…

Few-Shot Learning Novel Concepts TAR