DiffClass: Diffusion-Based Class Incremental Learning
Class Incremental Learning (CIL) is challenging due to catastrophic forgetting. On top of that, Exemplar-free Class Incremental Learning is even more challenging due to forbidden access to previous task data. Recent exemplar-free CIL methods attempt to mitigate catastrophic forgetting by synthesizing previous task data. However, they fail to overcome the catastrophic forgetting due to the inability to deal with the significant domain gap between real and synthetic data. To overcome these issues, we propose a novel exemplar-free CIL method. Our method adopts multi-distribution matching (MDM) diffusion models to unify quality and bridge domain gaps among all domains of training data. Moreover, our approach integrates selective synthetic image augmentation (SSIA) to expand the distribution of the training data, thereby improving the model's plasticity and reinforcing the performance of our method's ultimate component, multi-domain adaptation (MDA). With the proposed integrations, our method then reformulates exemplar-free CIL into a multi-domain adaptation problem to implicitly address the domain gap problem to enhance model stability during incremental training. Extensive experiments on benchmark class incremental datasets and settings demonstrate that our method excels previous exemplar-free CIL methods and achieves state-of-the-art performance.
Code (0)
등록된 구현이 없습니다.
Tasks
class-incremental learningClass Incremental LearningDomain AdaptationExemplar-FreeImage AugmentationIncremental LearningMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Class-Incremental Learning using Diffusion Model for Distillation and Replay
Class-incremental learning aims to learn new classes in an incremental fashion without forgetting the previously learned ones. Several research works have shown how additional data can be used by incremental models to he…
class-incremental learningClass Incremental LearningIncremental LearningSDDGR: Stable Diffusion-based Deep Generative Replay for Class Incremental Object Detection
In the field of class incremental learning (CIL), generative replay has become increasingly prominent as a method to mitigate the catastrophic forgetting, alongside the continuous improvements in generative models. Howev…
class-incremental learningClass Incremental LearningClass-Incremental Object DetectionIncremental Learning+3Data-Free Federated Class Incremental Learning with Diffusion-Based Generative Memory
Federated Class Incremental Learning (FCIL) is a critical yet largely underexplored issue that deals with the dynamic incorporation of new classes within federated learning (FL). Existing methods often employ generative …
class-incremental learningClass Incremental LearningFederated LearningIncremental Learning+2Diffusion Meets Few-shot Class Incremental Learning
Few-shot class-incremental learning (FSCIL) is challenging due to extremely limited training data; while aiming to reduce catastrophic forgetting and learn new information. We propose Diffusion-FSCIL, a novel approach th…
class-incremental learningClass Incremental LearningFew-Shot Class-Incremental LearningIncremental LearningFuture-Proofing Class Incremental Learning
Exemplar-Free Class Incremental Learning is a highly challenging setting where replay memory is unavailable. Methods relying on frozen feature extractors have drawn attention recently in this setting due to their impress…
class-incremental learningClass Incremental LearningExemplar-FreeIncremental Learning