Exemplar-free Class Incremental Learning via Discriminative and Comparable One-class Classifiers
The exemplar-free class incremental learning requires classification models to learn new class knowledge incrementally without retaining any old samples. Recently, the framework based on parallel one-class classifiers (POC), which trains a one-class classifier (OCC) independently for each category, has attracted extensive attention, since it can naturally avoid catastrophic forgetting. POC, however, suffers from weak discriminability and comparability due to its independent training strategy for different OOCs. To meet this challenge, we propose a new framework, named Discriminative and Comparable One-class classifiers for Incremental Learning (DisCOIL). DisCOIL follows the basic principle of POC, but it adopts variational auto-encoders (VAE) instead of other well-established one-class classifiers (e.g. deep SVDD), because a trained VAE can not only identify the probability of an input sample belonging to a class but also generate pseudo samples of the class to assist in learning new tasks. With this advantage, DisCOIL trains a new-class VAE in contrast with the old-class VAEs, which forces the new-class VAE to reconstruct better for new-class samples but worse for the old-class pseudo samples, thus enhancing the comparability. Furthermore, DisCOIL introduces a hinge reconstruction loss to ensure the discriminability. We evaluate our method extensively on MNIST, CIFAR10, and Tiny-ImageNet. The experimental results show that DisCOIL achieves state-of-the-art performance.
Code (1)
Tasks
class-incremental learningClass Incremental LearningExemplar-FreeExemplar-Free CountingIncremental LearningOne-class classifierSimilar Papers 제목 키워드 기반
Self-distilled Knowledge Delegator for Exemplar-free Class Incremental Learning
Exemplar-free incremental learning is extremely challenging due to inaccessibility of data from old tasks. In this paper, we attempt to exploit the knowledge encoded in a previously trained classification model to handle…
class-incremental learningClass Incremental LearningContinual LearningExemplar-Free+1Exemplar-Free Class Incremental Learning via Incremental Representation
Exemplar-Free Class Incremental Learning (efCIL) aims to continuously incorporate the knowledge from new classes while retaining previously learned information, without storing any old-class exemplars (i.e., samples). Fo…
class-incremental learningClass Incremental LearningExemplar-FreeIncremental LearningClass-Incremental Exemplar Compression for Class-Incremental Learning
Exemplar-based class-incremental learning (CIL) finetunes the model with all samples of new classes but few-shot exemplars of old classes in each incremental phase, where the "few-shot" abides by the limited memory budge…
Bilevel Optimizationclass-incremental learningClass Incremental LearningIncremental LearningPointCLIMB: An Exemplar-Free Point Cloud Class Incremental Benchmark
Point clouds offer comprehensive and precise data regarding the contour and configuration of objects. Employing such geometric and topological 3D information of objects in class incremental learning can aid endless appli…
class-incremental learningClass Incremental LearningExemplar-FreeIncremental LearningOn the Discrimination and Consistency for Exemplar-Free Class Incremental Learning
Exemplar-free class incremental learning (EF-CIL) is a nontrivial task that requires continuously enriching model capability with new classes while maintaining previously learned knowledge without storing and replaying a…
class-incremental learningClass Incremental LearningExemplar-FreeIncremental Learning