Enhancing Generative Class Incremental Learning Performance with Model Forgetting Approach

2024-03-27 · Taro Togo, Ren Togo, Keisuke Maeda, Takahiro Ogawa, Miki Haseyama

This study presents a novel approach to Generative Class Incremental Learning (GCIL) by introducing the forgetting mechanism, aimed at dynamically managing class information for better adaptation to streaming data. GCIL is one of the hot topics in the field of computer vision, and this is considered one of the crucial tasks in society, specifically the continual learning of generative models. The ability to forget is a crucial brain function that facilitates continual learning by selectively discarding less relevant information for humans. However, in the field of machine learning models, the concept of intentionally forgetting has not been extensively investigated. In this study we aim to bridge this gap by incorporating the forgetting mechanisms into GCIL, thereby examining their impact on the models' ability to learn in continual learning. Through our experiments, we have found that integrating the forgetting mechanisms significantly enhances the models' performance in acquiring new knowledge, underscoring the positive role that strategic forgetting plays in the process of continual learning.

📄 PDF Abstract BibTeX arXiv:2403.18258

Code (0)

등록된 구현이 없습니다.

Tasks

class-incremental learning Class Incremental Learning Continual Learning Incremental Learning

HSI Image Enhancement Classification Based on Knowledge Distillation: A Study on Forgetting

2026-03-19 · Songfeng Zhu arxiv

In incremental classification tasks for hyperspectral images, catastrophic forgetting is an unavoidable challenge. While memory recall methods can mitigate this issue, they heavily rely on samples from old categories. Th…

Knowledge Distillation Image Classification Image Enhancement

Make Domain Shift a Catastrophic Forgetting Alleviator in Class-Incremental Learning

2024-12-31 · Wei Chen, Yi Zhou

In the realm of class-incremental learning (CIL), alleviating the catastrophic forgetting problem is a pivotal challenge. This paper discovers a counter-intuitive observation: by incorporating domain shift into CIL tasks…

class-incremental learning Class Incremental Learning Contrastive Learning Incremental Learning

Few-shot Class-Incremental Learning via Generative Co-Memory Regularization

2026-01-12 · Kexin Bao, Yong Li, Dan Zeng, Shiming Ge arxiv

Few-shot class-incremental learning (FSCIL) aims to incrementally learn models from a small amount of novel data, which requires strong representation and adaptation ability of models learned under few-example supervisio…

Few-Shot Class-Incremental Learning Domain Adaptation

Controllable Forgetting Mechanism for Few-Shot Class-Incremental Learning

2025-01-27 · Kirill Paramonov, Mete Ozay, Eunju Yang, Jijoong Moon 외

Class-incremental learning in the context of limited personal labeled samples (few-shot) is critical for numerous real-world applications, such as smart home devices. A key challenge in these scenarios is balancing the t…

class-incremental learning Class Incremental Learning Few-Shot Class-Incremental Learning Incremental Learning

Class-Incremental Learning using Diffusion Model for Distillation and Replay

2023-06-30 · Quentin Jodelet, Xin Liu, Yin Jun Phua, Tsuyoshi Murata

Class-incremental learning aims to learn new classes in an incremental fashion without forgetting the previously learned ones. Several research works have shown how additional data can be used by incremental models to he…

class-incremental learning Class Incremental Learning Incremental Learning