Load-Aware Training Scheduling for Model Circulation-based Decentralized Federated Learning

2025-06-11 · Haruki Kainuma, Takayuki Nishio

This paper proposes Load-aware Tram-FL, an extension of Tram-FL that introduces a training scheduling mechanism to minimize total training time in decentralized federated learning by accounting for both computational and communication loads. The scheduling problem is formulated as a global optimization task, which-though intractable in its original form-is made solvable by decomposing it into node-wise subproblems. To promote balanced data utilization under non-IID distributions, a variance constraint is introduced, while the overall training latency, including both computation and communication costs, is minimized through the objective function. Simulation results on MNIST and CIFAR-10 demonstrate that Load-aware Tram-FL significantly reduces training time and accelerates convergence compared to baseline methods.

📄 PDF Abstract BibTeX arXiv:2506.09769

Code (0)

등록된 구현이 없습니다.

Tasks

Federated Learningglobal-optimizationScheduling

Caramel: Accelerating Decentralized Distributed Deep Learning with Computation Scheduling

2020-04-29 · Sayed Hadi Hashemi, Sangeetha Abdu Jyothi, Brighten Godfrey, Roy Campbell

The method of choice for parameter aggregation in Deep Neural Network (DNN) training, a network-intensive task, is shifting from the Parameter Server model to decentralized aggregation schemes (AllReduce) inspired by the…

Deep Learning Scheduling

Load Balancing in Federated Learning

2024-08-01 · Alireza Javani, Zhiying Wang

Federated Learning (FL) is a decentralized machine learning framework that enables learning from data distributed across multiple remote devices, enhancing communication efficiency and data privacy. Due to limited commun…

Decision Making Fairness Federated Learning Scheduling

DeFRiS: Silo-Cooperative IoT Applications Scheduling via Decentralized Federated Reinforcement Learning

2026-03-16 · Zhiyu Wang, Mohammad Goudarzi, Mingming Gong, Rajkumar Buyya arxiv

Next-generation IoT applications increasingly span across autonomous administrative entities, necessitating silo-cooperative scheduling to leverage diverse computational resources while preserving data privacy. However, …

Reinforcement Learning Anomaly Detection

Decentralized Task Scheduling in Distributed Systems: A Deep Reinforcement Learning Approach

2026-03-25 · Daniel Benniah John arxiv

Efficient task scheduling in large-scale distributed systems presents significant challenges due to dynamic workloads, heterogeneous resources, and competing quality-of-service requirements. Traditional centralized appro…

Reinforcement Learning

A centralized reinforcement learning method for multi-agent job scheduling in Grid

2016-09-11 · Milad Moradi

One of the main challenges in Grid systems is designing an adaptive, scalable, and model-independent method for job scheduling to achieve a desirable degree of load balancing and system efficiency. Centralized job schedu…

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)Scheduling