A Multi-agent Reinforcement Learning Approach for Efficient Client Selection in Federated Learning

2022-01-09 · Sai Qian Zhang, Jieyu Lin, Qi Zhang

Federated learning (FL) is a training technique that enables client devices to jointly learn a shared model by aggregating locally-computed models without exposing their raw data. While most of the existing work focuses on improving the FL model accuracy, in this paper, we focus on the improving the training efficiency, which is often a hurdle for adopting FL in real-world applications. Specifically, we design an efficient FL framework which jointly optimizes model accuracy, processing latency and communication efficiency, all of which are primary design considerations for real implementation of FL. Inspired by the recent success of Multi-Agent Reinforcement Learning (MARL) in solving complex control problems, we present \textit{FedMarl}, an MARL-based FL framework which performs efficient run-time client selection. Experiments show that FedMarl can significantly improve model accuracy with much lower processing latency and communication cost.

📄 PDF Abstract BibTeX arXiv:2201.02932

Code (0)

등록된 구현이 없습니다.

Tasks

Federated Learning Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning (RL)

Learning-Based Client Selection for Federated Learning Services Over Wireless Networks with Constrained Monetary Budgets

2022-08-08 · Zhipeng Cheng, Xuwei Fan, Minghui LiWang, Ning Chen 외

We investigate a data quality-aware dynamic client selection problem for multiple federated learning (FL) services in a wireless network, where each client offers dynamic datasets for the simultaneous training of multipl…

Deep Reinforcement Learning Federated Learning reinforcement-learning Reinforcement Learning (RL)

Coordinated Attacks Against Federated Learning: A Multi-Agent Reinforcement Learning Approach

2021-09-29 · Wen Shen, Henger Li, Zizhan Zheng

We propose a model-based multi-agent reinforcement learning attack framework against federated learning systems. Our framework first approximates the distribution of the clients' aggregated data through cooperative multi…

Federated Learning Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning+1

Federated Client Selection under Partial Visibility: A POMDP Approach with Spatio-Temporal Attention

2026-05-12 · Qijun Hou, Yuchen Shi, Pingyi Fan, Khaled B. Letaief arxiv

Federated learning relies on effective client selection to alleviate the performance degradation caused by data heterogeneity. Most existing methods assume full visibility of all clients at each communication round. Howe…

Reinforcement Learning Federated Learning

FedMRL: Data Heterogeneity Aware Federated Multi-agent Deep Reinforcement Learning for Medical Imaging

2024-07-08 · Pranab Sahoo, Ashutosh Tripathi, Sriparna Saha, Samrat Mondal

Despite recent advancements in federated learning (FL) for medical image diagnosis, addressing data heterogeneity among clients remains a significant challenge for practical implementation. A primary hurdle in FL arises …

Deep Reinforcement Learning Fairness Federated Learning Multi-agent Reinforcement Learning+2

On-Demand Model and Client Deployment in Federated Learning with Deep Reinforcement Learning

2024-05-12 · Mario Chahoud, Hani Sami, Azzam Mourad, Hadi Otrok 외

In Federated Learning (FL), the limited accessibility of data from diverse locations and user types poses a significant challenge due to restricted user participation. Expanding client access and diversifying data enhanc…

Deep Reinforcement Learning Federated Learning reinforcement-learning Reinforcement Learning