Go ahead and do not forget: Modular lifelong learning from event-based data
Lifelong learning is a long-standing aim for artificial agents that act in dynamic environments in which an agent needs to accumulate knowledge incrementally without forgetting previously learned representations. Contemporary methods for incremental learning from images are predominantly based on frame-based data recorded by conventional shutter cameras. We investigate methods for learning from data produced by event cameras and compare techniques to mitigate forgetting while learning incrementally. We propose a model that is composed of both, feature extraction and incremental learning. The feature extractor is utilized as a self-supervised sparse convolutional neural network that processes event-based data. The incremental learner uses a habituation-based method that works in tandem with other existing techniques. Our experimental results show that the combination of different existing techniques with our proposed habituation-based method can help avoid catastrophic forgetting even more, while learning incrementally from the features provided by the extraction module.
Code (1)
Tasks
Incremental LearningLifelong learningSimilar Papers 제목 키워드 기반
VERSE: Virtual-Gradient Aware Streaming Lifelong Learning with Anytime Inference
Lifelong learning or continual learning is the problem of training an AI agent continuously while also preventing it from forgetting its previously acquired knowledge. Streaming lifelong learning is a challenging setting…
AI AgentContinual LearningLifelong learningRepresentation LearningLifelong Learning from Event-based Data
Lifelong learning is a long-standing aim for artificial agents that act in dynamic environments, in which an agent needs to accumulate knowledge incrementally without forgetting previously learned representations. We inv…
Lifelong learningMeta-Learning with Sparse Experience Replay for Lifelong Language Learning
Lifelong learning requires models that can continuously learn from sequential streams of data without suffering catastrophic forgetting due to shifts in data distributions. Deep learning models have thrived in the non-se…
Continual LearningLifelong learningMeta-LearningRelation Extraction+2Meta-Learning with Sparse Experience Replay for Lifelong Language Learning
Lifelong learning requires models that can continuously learn from sequential streams of data without suffering catastrophic forgetting due to shifts in data distributions. Deep learning models have thrived in the non-se…
Lifelong learningMeta-LearningRelation Extractiontext-classification+1LFS-GAN: Lifelong Few-Shot Image Generation
We address a challenging lifelong few-shot image generation task for the first time. In this situation, a generative model learns a sequence of tasks using only a few samples per task. Consequently, the learned model enc…
Image Generation