Parameterizing Federated Continual Learning for Reproducible Research
Federated Learning (FL) systems evolve in heterogeneous and ever-evolving environments that challenge their performance. Under real deployments, the learning tasks of clients can also evolve with time, which calls for the integration of methodologies such as Continual Learning. To enable research reproducibility, we propose a set of experimental best practices that precisely capture and emulate complex learning scenarios. Our framework, Freddie, is the first entirely configurable framework for Federated Continual Learning (FCL), and it can be seamlessly deployed on a large number of machines thanks to the use of Kubernetes and containerization. We demonstrate the effectiveness of Freddie on two use cases, (i) large-scale FL on CIFAR100 and (ii) heterogeneous task sequence on FCL, which highlight unaddressed performance challenges in FCL scenarios.
Code (0)
등록된 구현이 없습니다.
Tasks
Continual LearningFederated LearningMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Benchmarking Catastrophic Forgetting Mitigation Methods in Federated Time Series Forecasting
Catastrophic forgetting (CF) poses a persistent challenge in continual learning (CL), especially within federated learning (FL) environments characterized by non-i.i.d. time series data. While existing research has large…
Time Series ForecastingFederated LearningContinual LearningFederated Continual Learning with Weighted Inter-client Transfer
There has been a surge of interest in continual learning and federated learning, both of which are important in deep neural networks in real-world scenarios. Yet little research has been done regarding the scenario where…
Continual LearningFederated LearningTransfer LearningContinual Reinforcement Learning with TELLA
Training reinforcement learning agents that continually learn across multiple environments is a challenging problem. This is made more difficult by a lack of reproducible experiments and standard metrics for comparing di…
Continual LearningLifelong learningreinforcement-learningReinforcement Learning+1Federated Continual Learning for Edge-AI: A Comprehensive Survey
Edge-AI, the convergence of edge computing and artificial intelligence (AI), has become a promising paradigm that enables the deployment of advanced AI models at the network edge, close to users. In Edge-AI, federated co…
Continual LearningEdge-computingSurveyLibContinual: A Comprehensive Library towards Realistic Continual Learning
A fundamental challenge in Continual Learning (CL) is catastrophic forgetting, where adapting to new tasks degrades the performance on previous ones. While the field has evolved with diverse methods, this rapid surge in …
Continual Learning