Knowing when we do not know: Bayesian continual learning for sensing-based analysis tasks
Despite much research targeted at enabling conventional machine learning models to continually learn tasks and data distributions sequentially without forgetting the knowledge acquired, little effort has been devoted to account for more realistic situations where learning some tasks accurately might be more critical than forgetting previous ones. In this paper we propose a Bayesian inference based framework to continually learn a set of real-world, sensing-based analysis tasks that can be tuned to prioritize the remembering of previously learned tasks or the learning of new ones. Our experiments prove the robustness and reliability of the learned models to adapt to the changing sensing environment, and show the suitability of using uncertainty of the predictions to assess their reliability.
Code (0)
등록된 구현이 없습니다.
Tasks
Bayesian InferenceContinual LearningSimilar Papers 제목 키워드 기반
Continual Learning Without Knowing Task Identities: Rethinking Occam's Razor
Due to the catastrophic forgetting phenomenon of deep neural networks (DNNs), models trained in standard ways tend to forget what it has learned from previous tasks, especially when the new task is sufficiently different…
Continual LearningModel SelectionBayesian Federated Learning for Continual Training
Bayesian Federated Learning (BFL) enables uncertainty quantification and robust adaptation in distributed learning. In contrast to the frequentist approach, it estimates the posterior distribution of a global model, offe…
Continual LearningFederated LearningUncertainty QuantificationFacilitating Bayesian Continual Learning by Natural Gradients and Stein Gradients
Continual learning aims to enable machine learning models to learn a general solution space for past and future tasks in a sequential manner. Conventional models tend to forget the knowledge of previous tasks while learn…
Continual LearningTask 2Continual Learning with Memory Cascades
Continual learning poses an important challenge to machine learning models. Kirkpatrick et al. introduced a model that combats forgetting during continual learning by using a Bayesian prior to transfer knowledge between …
Continual LearningPermuted-MNISTThe Bayesian Approach to Continual Learning: An Overview
Continual learning is an online paradigm where a learner continually accumulates knowledge from different tasks encountered over sequential time steps. Importantly, the learner is required to extend and update its knowle…
Bayesian Inferenceclass-incremental learningClass Incremental LearningContinual Learning+4