Scheduling and Communication Schemes for Decentralized Federated Learning
Federated learning (FL) is a distributed machine learning paradigm in which a large number of clients coordinate with a central server to learn a model without sharing their own training data. One central server is not enough, due to problems of connectivity with clients. In this paper, a decentralized federated learning (DFL) model with the stochastic gradient descent (SGD) algorithm has been introduced, as a more scalable approach to improve the learning performance in a network of agents with arbitrary topology. Three scheduling policies for DFL have been proposed for communications between the clients and the parallel servers, and the convergence, accuracy, and loss have been tested in a totally decentralized mplementation of SGD. The experimental results show that the proposed scheduling polices have an impact both on the speed of convergence and in the final global model.
Code (0)
등록된 구현이 없습니다.
Tasks
Federated LearningSchedulingMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Load-Aware Training Scheduling for Model Circulation-based Decentralized Federated Learning
This paper proposes Load-aware Tram-FL, an extension of Tram-FL that introduces a training scheduling mechanism to minimize total training time in decentralized federated learning by accounting for both computational and…
Federated Learningglobal-optimizationSchedulingA Multi-Token Coordinate Descent Method for Semi-Decentralized Vertical Federated Learning
Communication efficiency is a major challenge in federated learning (FL). In client-server schemes, the server constitutes a bottleneck, and while decentralized setups spread communications, they do not necessarily reduc…
Federated LearningVertical Federated LearningLoad Balancing in Federated Learning
Federated Learning (FL) is a decentralized machine learning framework that enables learning from data distributed across multiple remote devices, enhancing communication efficiency and data privacy. Due to limited commun…
Decision MakingFairnessFederated LearningSchedulingTRAIL: Trust-Aware Client Scheduling for Semi-Decentralized Federated Learning
Due to the sensitivity of data, Federated Learning (FL) is employed to enable distributed machine learning while safeguarding data privacy and accommodating the requirements of various devices. However, in the context of…
Federated LearningSchedulingOCD-FL: A Novel Communication-Efficient Peer Selection-based Decentralized Federated Learning
The conjunction of edge intelligence and the ever-growing Internet-of-Things (IoT) network heralds a new era of collaborative machine learning, with federated learning (FL) emerging as the most prominent paradigm. With t…
Federated Learning