Evaluation of Regularization-based Continual Learning Approaches: Application to HAR
Pervasive computing allows the provision of services in many important areas, including the relevant and dynamic field of health and well-being. In this domain, Human Activity Recognition (HAR) has gained a lot of attention in recent years. Current solutions rely on Machine Learning (ML) models and achieve impressive results. However, the evolution of these models remains difficult, as long as a complete retraining is not performed. To overcome this problem, the concept of Continual Learning is very promising today and, more particularly, the techniques based on regularization. These techniques are particularly interesting for their simplicity and their low cost. Initial studies have been conducted and have shown promising outcomes. However, they remain very specific and difficult to compare. In this paper, we provide a comprehensive comparison of three regularization-based methods that we adapted to the HAR domain, highlighting their strengths and limitations. Our experiments were conducted on the UCI HAR dataset and the results showed that no single technique outperformed all others in all scenarios considered.
Code (0)
등록된 구현이 없습니다.
Tasks
Activity RecognitionContinual LearningHuman Activity RecognitionSimilar Papers 제목 키워드 기반
Adaptive Variance-Penalized Continual Learning with Fisher Regularization
The persistent challenge of catastrophic forgetting in neural networks has motivated extensive research in continual learning . This work presents a novel continual learning framework that integrates Fisher-weighted asym…
Continual LearningDark Experience for General Continual Learning: a Strong, Simple Baseline
Continual Learning has inspired a plethora of approaches and evaluation settings; however, the majority of them overlooks the properties of a practical scenario, where the data stream cannot be shaped as a sequence of ta…
class-incremental learningClass Incremental LearningContinual LearningKnowledge DistillationRegularization Shortcomings for Continual Learning
In most machine learning algorithms, training data is assumed to be independent and identically distributed (iid). When it is not the case, the algorithm's performances are challenged, leading to the famous phenomenon of…
Continual LearningMulti-Task LearningA Closer Look at Rehearsal-Free Continual Learning
Continual learning is a setting where machine learning models learn novel concepts from continuously shifting training data, while simultaneously avoiding degradation of knowledge on previously seen classes which may dis…
Continual LearningKnowledge DistillationL2 RegularizationNovel ConceptsRTRA: Rapid Training of Regularization-based Approaches in Continual Learning
Catastrophic forgetting(CF) is a significant challenge in continual learning (CL). In regularization-based approaches to mitigate CF, modifications to important training parameters are penalized in subsequent tasks using…
Continual Learning