Understanding Continual Learning Settings with Data Distribution Drift Analysis
Classical machine learning algorithms often assume that the data are drawn i.i.d. from a stationary probability distribution. Recently, continual learning emerged as a rapidly growing area of machine learning where this assumption is relaxed, i.e. where the data distribution is non-stationary and changes over time. This paper represents the state of data distribution by a context variable $c$. A drift in $c$ leads to a data distribution drift. A context drift may change the target distribution, the input distribution, or both. Moreover, distribution drifts might be abrupt or gradual. In continual learning, context drifts may interfere with the learning process and erase previously learned knowledge; thus, continual learning algorithms must include specialized mechanisms to deal with such drifts. In this paper, we aim to identify and categorize different types of context drifts and potential assumptions about them, to better characterize various continual-learning scenarios. Moreover, we propose to use the distribution drift framework to provide more precise definitions of several terms commonly used in the continual learning field.
Code (0)
등록된 구현이 없습니다.
Tasks
BIG-bench Machine LearningContinual LearningSimilar Papers 제목 키워드 기반
Continuum: Simple Management of Complex Continual Learning Scenarios
Continual learning is a machine learning sub-field specialized in settings with non-iid data. Hence, the training data distribution is not static and drifts through time. Those drifts might cause interferences in the tra…
Continual LearningManagementEfficient Online Continual Foundation Model Fine-Tuning for Predictive Process Monitoring
Predictive Process Monitoring (PPM) models are increasingly deployed in dynamic environments where concept drift causes the underlying process distribution to shift over time. While recent work has moved toward online co…
Continual LearningNon-Stationary Learning of Neural Networks with Automatic Soft Parameter Reset
Neural networks are traditionally trained under the assumption that data come from a stationary distribution. However, settings which violate this assumption are becoming more popular; examples include supervised learnin…
Continual LearningMulti-Armed Banditsreinforcement-learningReinforcement LearningExemplar-free Continual Representation Learning via Learnable Drift Compensation
Exemplar-free class-incremental learning using a backbone trained from scratch and starting from a small first task presents a significant challenge for continual representation learning. Prototype-based approaches, when…
class-incremental learningClass Incremental LearningContinual LearningExemplar-Free+2Continual Learning in Deep Networks: an Analysis of the Last Layer
We study how different output layer parameterizations of a deep neural network affects learning and forgetting in continual learning settings. The following three effects can cause catastrophic forgetting in the output l…
Continual Learning