paper-with-me

홈 › Papers

Cross-Class Feature Augmentation for Class Incremental Learning

2023-04-04 · TaeHoon Kim, Jaeyoo Park, Bohyung Han

We propose a novel class incremental learning approach by incorporating a feature augmentation technique motivated by adversarial attacks. We employ a classifier learned in the past to complement training examples rather than simply play a role as a teacher for knowledge distillation towards subsequent models. The proposed approach has a unique perspective to utilize the previous knowledge in class incremental learning since it augments features of arbitrary target classes using examples in other classes via adversarial attacks on a previously learned classifier. By allowing the cross-class feature augmentations, each class in the old tasks conveniently populates samples in the feature space, which alleviates the collapse of the decision boundaries caused by sample deficiency for the previous tasks, especially when the number of stored exemplars is small. This idea can be easily incorporated into existing class incremental learning algorithms without any architecture modification. Extensive experiments on the standard benchmarks show that our method consistently outperforms existing class incremental learning methods by significant margins in various scenarios, especially under an environment with an extremely limited memory budget.

📄 PDF Abstract BibTeX arXiv:2304.01899

Code (0)

등록된 구현이 없습니다.

Tasks

class-incremental learningClass Incremental LearningIncremental LearningKnowledge Distillation

Methods 이 논문이 사용한 방법론

Knowledge Distillation A very simple way to improve the performance of almost any machine learning algorithm is to train many different models on the same data and then to average their predictions.…

Similar Papers 제목 키워드 기반

Class-Incremental Learning via Dual Augmentation

2021-12-01 · NeurIPS 2021 12 · Fei Zhu, Zhen Cheng, Xu-Yao Zhang, Cheng-Lin Liu

Deep learning systems typically suffer from catastrophic forgetting of past knowledge when acquiring new skills continually. In this paper, we emphasize two dilemmas, representation bias and classifier bias in class-incr…

class-incremental learningClass Incremental LearningIncremental Learning

Transfer Incremental Learning using Data Augmentation

2018-10-04 · Ghouthi Boukli Hacene, Vincent Gripon, Nicolas Farrugia, Matthieu Arzel 외

Deep learning-based methods have reached state of the art performances, relying on large quantity of available data and computational power. Such methods still remain highly inappropriate when facing a major open machine…

Data AugmentationIncremental Learning

Non-exemplar Class-incremental Learning by Random Auxiliary Classes Augmentation and Mixed Features

2023-04-16 · Ke Song, Quan Xia, Guoqiang Liang, Zhaojie Chen 외

Non-exemplar class-incremental learning refers to classifying new and old classes without storing samples of old classes. Since only new class samples are available for optimization, it often occurs catastrophic forgetti…

class-incremental learningClass Incremental LearningIncremental Learning

Few-shot Class-incremental Learning for Cross-domain Disease Classification

2023-04-12 · Hao Yang, Weijian Huang, Jiarun Liu, Cheng Li 외

The ability to incrementally learn new classes from limited samples is crucial to the development of artificial intelligence systems for real clinical application. Although existing incremental learning techniques have a…

class-incremental learningClass Incremental LearningCross-Domain Few-ShotData Augmentation+2

Few-Shot Class-Incremental Learning from an Open-Set Perspective

2022-07-30 · Can Peng, Kun Zhao, Tianren Wang, Meng Li 외

The continual appearance of new objects in the visual world poses considerable challenges for current deep learning methods in real-world deployments. The challenge of new task learning is often exacerbated by the scarci…

class-incremental learningClass Incremental LearningData AugmentationFace Recognition+2