Memorizing Complementation Network for Few-Shot Class-Incremental Learning

2022-08-11 · Zhong Ji, Zhishen Hou, Xiyao Liu, Yanwei Pang, Xuelong Li

Few-shot Class-Incremental Learning (FSCIL) aims at learning new concepts continually with only a few samples, which is prone to suffer the catastrophic forgetting and overfitting problems. The inaccessibility of old classes and the scarcity of the novel samples make it formidable to realize the trade-off between retaining old knowledge and learning novel concepts. Inspired by that different models memorize different knowledge when learning novel concepts, we propose a Memorizing Complementation Network (MCNet) to ensemble multiple models that complements the different memorized knowledge with each other in novel tasks. Additionally, to update the model with few novel samples, we develop a Prototype Smoothing Hard-mining Triplet (PSHT) loss to push the novel samples away from not only each other in current task but also the old distribution. Extensive experiments on three benchmark datasets, e.g., CIFAR100, miniImageNet and CUB200, have demonstrated the superiority of our proposed method.

📄 PDF Abstract BibTeX arXiv:2208.05610

Code (0)

등록된 구현이 없습니다.

Tasks

class-incremental learning Class Incremental Learning Few-Shot Class-Incremental Learning Incremental LearningNovel ConceptsTriplet

Knowledge Transfer-Driven Few-Shot Class-Incremental Learning

2023-06-19 · Ye Wang, Yaxiong Wang, Guoshuai Zhao, Xueming Qian

Few-shot class-incremental learning (FSCIL) aims to continually learn new classes using a few samples while not forgetting the old classes. The key of this task is effective knowledge transfer from the base session to th…

class-incremental learning Class Incremental Learning Few-Shot Class-Incremental Learning Incremental Learning+1

Learnable Distribution Calibration for Few-Shot Class-Incremental Learning

2022-10-01 · Binghao Liu, Boyu Yang, Lingxi Xie, Ren Wang 외

Few-shot class-incremental learning (FSCIL) faces challenges of memorizing old class distributions and estimating new class distributions given few training samples. In this study, we propose a learnable distribution cal…

class-incremental learning Class Incremental Learning Few-Shot Class-Incremental Learning Few-Shot Learning+2

Prompt Learning With Knowledge Memorizing Prototypes For Generalized Few-Shot Intent Detection

2023-09-10 · Chaiyut Luoyiching, Yangning Li, Yinghui Li, Rongsheng Li 외

Generalized Few-Shot Intent Detection (GFSID) is challenging and realistic because it needs to categorize both seen and novel intents simultaneously. Previous GFSID methods rely on the episodic learning paradigm, which m…

class-incremental learning Class Incremental Learning Incremental Learning Intent Detection+1

Learning without Memorizing

2018-11-20 · CVPR 2019 6 · Prithviraj Dhar, Rajat Vikram Singh, Kuan-Chuan Peng, Ziyan Wu 외

Incremental learning (IL) is an important task aimed at increasing the capability of a trained model, in terms of the number of classes recognizable by the model. The key problem in this task is the requirement of storin…

Incremental Learning

On the Power of Unambiguity in Büchi Complementation

2020-05-18 · Yong Li, Moshe Y. Vardi, Lijun Zhang

In this work, we exploit the power of \emph{unambiguity} for the complementation problem of B\"uchi automata by utilizing reduced run directed acyclic graphs (DAGs) over infinite words, in which each vertex has at most o…