iCaRL: Incremental Classifier and Representation Learning
A major open problem on the road to artificial intelligence is the development of incrementally learning systems that learn about more and more concepts over time from a stream of data. In this work, we introduce a new training strategy, iCaRL, that allows learning in such a class-incremental way: only the training data for a small number of classes has to be present at the same time and new classes can be added progressively. iCaRL learns strong classifiers and a data representation simultaneously. This distinguishes it from earlier works that were fundamentally limited to fixed data representations and therefore incompatible with deep learning architectures. We show by experiments on CIFAR-100 and ImageNet ILSVRC 2012 data that iCaRL can learn many classes incrementally over a long period of time where other strategies quickly fail.
Code (10)
Tasks
class-incremental learningClass Incremental LearningIncremental LearningRepresentation LearningSimilar Papers 제목 키워드 기반
FastICARL: Fast Incremental Classifier and Representation Learning with Efficient Budget Allocation in Audio Sensing Applications
Various incremental learning (IL) approaches have been proposed to help deep learning models learn new tasks/classes continuously without forgetting what was learned previously (i.e., avoid catastrophic forgetting). With…
Incremental LearningQuantizationRepresentation LearningA First Look at Class Incremental Learning in Deep Learning Mobile Traffic Classification
The recent popularity growth of Deep Learning (DL) re-ignited the interest towards traffic classification, with several studies demonstrating the accuracy of DL-based classifiers to identify Internet applications' traffi…
class-incremental learningClass Incremental LearningIncremental LearningTraffic ClassificationRevisiting Distillation and Incremental Classifier Learning
One of the key differences between the learning mechanism of humans and Artificial Neural Networks (ANNs) is the ability of humans to learn one task at a time. ANNs, on the other hand, can only learn multiple tasks simul…
Incremental LearningKnowledge DistillationOnline Continual Learning in Image Classification: An Empirical Survey
Online continual learning for image classification studies the problem of learning to classify images from an online stream of data and tasks, where tasks may include new classes (class incremental) or data nonstationari…
ClassificationContinual LearningGeneral Classificationimage-classification+2Diagnosing Batch Normalization in Class Incremental Learning
Extensive researches have applied deep neural networks (DNNs) in class incremental learning (Class-IL). As building blocks of DNNs, batch normalization (BN) standardizes intermediate feature maps and has been widely vali…
class-incremental learningClass Incremental LearningIncremental LearningRepresentation Learning