A Reinforcement Learning-Based Approach to Graph Discovery in D2D-Enabled Federated Learning

2023-08-07 · Satyavrat Wagle, Anindya Bijoy Das, David J. Love, Christopher G. Brinton

Augmenting federated learning (FL) with direct device-to-device (D2D) communications can help improve convergence speed and reduce model bias through rapid local information exchange. However, data privacy concerns, device trust issues, and unreliable wireless channels each pose challenges to determining an effective yet resource efficient D2D structure. In this paper, we develop a decentralized reinforcement learning (RL) methodology for D2D graph discovery that promotes communication of non-sensitive yet impactful data-points over trusted yet reliable links. Each device functions as an RL agent, training a policy to predict the impact of incoming links. Local (device-level) and global rewards are coupled through message passing within and between device clusters. Numerical experiments confirm the advantages offered by our method in terms of convergence speed and straggler resilience across several datasets and FL schemes.

📄 PDF Abstract BibTeX arXiv:2308.03933

Code (0)

등록된 구현이 없습니다.

Tasks

Federated Learning Reinforcement Learning (RL)

Methods 이 논문이 사용한 방법론

SPEED The monocular depth estimation (MDE) is the task of estimating depth from a single frame. This information is an essential knowledge in many computer vision tasks such as scene…

Multi-Agent Reinforcement Learning for Graph Discovery in D2D-Enabled Federated Learning

2025-03-29 · Satyavrat Wagle, Anindya Bijoy Das, David J. Love, Christopher G. Brinton

Augmenting federated learning (FL) with device-to-device (D2D) communications can help improve convergence speed and reduce model bias through local information exchange. However, data privacy concerns, trust constraints…

Diversity Federated Learning Multi-agent Reinforcement Learning Reinforcement Learning (RL)

Distributed Deep Reinforcement Learning Based Gradient Quantization for Federated Learning Enabled Vehicle Edge Computing

2024-07-11 · Cui Zhang, Wenjun Zhang, Qiong Wu, Pingyi Fan 외

Federated Learning (FL) can protect the privacy of the vehicles in vehicle edge computing (VEC) to a certain extent through sharing the gradients of vehicles' local models instead of local data. The gradients of vehicles…

Deep Reinforcement Learning Edge-computing Federated Learning Quantization

Resource Management for Blockchain-enabled Federated Learning: A Deep Reinforcement Learning Approach

2020-04-08 · Nguyen Quang Hieu, Tran The Anh, Nguyen Cong Luong, Dusit Niyato 외

Blockchain-enabled Federated Learning (BFL) enables mobile devices to collaboratively train neural network models required by a Machine Learning Model Owner (MLMO) while keeping data on the mobile devices. Then, the mode…

CPU Deep Reinforcement Learning Federated Learning Management+3

Federated Causal Discovery From Interventions

2022-11-07 · Amin Abyaneh, Nino Scherrer, Patrick Schwab, Stefan Bauer 외

Causal discovery serves a pivotal role in mitigating model uncertainty through recovering the underlying causal mechanisms among variables. In many practical domains, such as healthcare, access to the data gathered by in…

Causal Discovery Federated Learning Privacy Preserving

Regret-Based Federated Causal Discovery with Unknown Interventions

2025-12-29 · Federico Baldo, Charles K. Assaad arxiv

Most causal discovery methods recover a completed partially directed acyclic graph representing a Markov equivalence class from observational data. Recent work has extended these methods to federated settings to address …