Asynchronous Federated Continual Learning
The standard class-incremental continual learning setting assumes a set of tasks seen one after the other in a fixed and predefined order. This is not very realistic in federated learning environments where each client works independently in an asynchronous manner getting data for the different tasks in time-frames and orders totally uncorrelated with the other ones. We introduce a novel federated learning setting (AFCL) where the continual learning of multiple tasks happens at each client with different orderings and in asynchronous time slots. We tackle this novel task using prototype-based learning, a representation loss, fractal pre-training, and a modified aggregation policy. Our approach, called FedSpace, effectively tackles this task as shown by the results on the CIFAR-100 dataset using 3 different federated splits with 50, 100, and 500 clients, respectively. The code and federated splits are available at https://github.com/LTTM/FedSpace.
Code (1)
Tasks
Continual LearningFederated LearningSimilar Papers 제목 키워드 기반
Fed-CPrompt: Contrastive Prompt for Rehearsal-Free Federated Continual Learning
Federated continual learning (FCL) learns incremental tasks over time from confidential datasets distributed across clients. This paper focuses on rehearsal-free FCL, which has severe forgetting issues when learning new …
Continual LearningPrompt LearningFederated Continual Learning via Knowledge Fusion: A Survey
Data privacy and silos are nontrivial and greatly challenging in many real-world applications. Federated learning is a decentralized approach to training models across multiple local clients without the exchange of raw d…
Continual LearningFederated LearningSurveyDynamic Allocation Hypernetwork with Adaptive Model Recalibration for Federated Continual Learning
Federated continual learning (FCL) offers an emerging pattern to facilitate the applicability of federated learning (FL) in real-world scenarios, where tasks evolve dynamically and asynchronously across clients, especial…
Continual LearningFederated LearningFedProK: Trustworthy Federated Class-Incremental Learning via Prototypical Feature Knowledge Transfer
Federated Class-Incremental Learning (FCIL) focuses on continually transferring the previous knowledge to learn new classes in dynamic Federated Learning (FL). However, existing methods do not consider the trustworthines…
class-incremental learningClass Incremental LearningFederated LearningIncremental Learning+1Dynamic Allocation Hypernetwork with Adaptive Model Recalibration for FCL
Federated continual learning (FCL) offers an emerging pattern to facilitate the applicability of federated learning (FL) in real-world scenarios, where tasks evolve dynamically and asynchronously across clients, especial…
Continual LearningFederated Learning