Continual Learning in Practice
This paper describes a reference architecture for self-maintaining systems that can learn continually, as data arrives. In environments where data evolves, we need architectures that manage Machine Learning (ML) models in production, adapt to shifting data distributions, cope with outliers, retrain when necessary, and adapt to new tasks. This represents continual AutoML or Automatically Adaptive Machine Learning. We describe the challenges and proposes a reference architecture.
Code (0)
등록된 구현이 없습니다.
Tasks
AutoMLBIG-bench Machine LearningContinual LearningSimilar Papers 제목 키워드 기반
Continual Inference: A Library for Efficient Online Inference with Deep Neural Networks in PyTorch
We present Continual Inference, a Python library for implementing Continual Inference Networks (CINs) in PyTorch, a class of Neural Networks designed specifically for efficient inference in both online and batch processi…
Sustainable Artificial Intelligence through Continual Learning
The increasing attention on Artificial Intelligence (AI) regulation has led to the definition of a set of ethical principles grouped into the Sustainable AI framework. In this article, we identify Continual Learning, an …
Continual LearningRenate: A Library for Real-World Continual Learning
Continual learning enables the incremental training of machine learning models on non-stationary data streams.While academic interest in the topic is high, there is little indication of the use of state-of-the-art contin…
Continual LearningGeneralisation Guarantees for Continual Learning with Orthogonal Gradient Descent
In Continual Learning settings, deep neural networks are prone to Catastrophic Forgetting. Orthogonal Gradient Descent was proposed to tackle the challenge. However, no theoretical guarantees have been proven yet. We pre…
Continual LearningTransfer LearningImproving and Understanding Variational Continual Learning
In the continual learning setting, tasks are encountered sequentially. The goal is to learn whilst i) avoiding catastrophic forgetting, ii) efficiently using model capacity, and iii) employing forward and backward transf…
Continual LearningPermuted-MNISTSplit-MNISTTransfer Learning