Distributed Deep Reinforcement Learning Based Gradient Quantization for Federated Learning Enabled Vehicle Edge Computing

2024-07-11 · Cui Zhang, Wenjun Zhang, Qiong Wu, Pingyi Fan, Qiang Fan, Jiangzhou Wang, Khaled B. Letaief

Federated Learning (FL) can protect the privacy of the vehicles in vehicle edge computing (VEC) to a certain extent through sharing the gradients of vehicles' local models instead of local data. The gradients of vehicles' local models are usually large for the vehicular artificial intelligence (AI) applications, thus transmitting such large gradients would cause large per-round latency. Gradient quantization has been proposed as one effective approach to reduce the per-round latency in FL enabled VEC through compressing gradients and reducing the number of bits, i.e., the quantization level, to transmit gradients. The selection of quantization level and thresholds determines the quantization error, which further affects the model accuracy and training time. To do so, the total training time and quantization error (QE) become two key metrics for the FL enabled VEC. It is critical to jointly optimize the total training time and QE for the FL enabled VEC. However, the time-varying channel condition causes more challenges to solve this problem. In this paper, we propose a distributed deep reinforcement learning (DRL)-based quantization level allocation scheme to optimize the long-term reward in terms of the total training time and QE. Extensive simulations identify the optimal weighted factors between the total training time and QE, and demonstrate the feasibility and effectiveness of the proposed scheme.

📄 PDF Abstract BibTeX arXiv:2407.08462

Code (0)

등록된 구현이 없습니다.

Tasks

Deep Reinforcement LearningEdge-computingFederated Learning Quantization

$\texttt{DoStoVoQ}$: Doubly Stochastic Voronoi Vector Quantization SGD for Federated Learning

2021-05-21 · NeurIPS 2021 12 · Louis Leconte, Aymeric Dieuleveut, Edouard Oyallon, Eric Moulines 외

The growing size of models and datasets have made distributed implementation of stochastic gradient descent (SGD) an active field of research. However the high bandwidth cost of communicating gradient updates between nod…

Federated Learning Quantization

Wyner-Ziv Gradient Compression for Federated Learning

2021-11-16 · Kai Liang, Huiru Zhong, Haoning Chen, Youlong Wu

Due to limited communication resources at the client and a massive number of model parameters, large-scale distributed learning tasks suffer from communication bottleneck. Gradient compression is an effective method to r…

Federated Learning Quantization

Communication Efficient Federated Learning over Multiple Access Channels

2020-01-23 · Wei-Ting Chang, Ravi Tandon

In this work, we study the problem of federated learning (FL), where distributed users aim to jointly train a machine learning model with the help of a parameter server (PS). In each iteration of FL, users compute local …

Federated Learning Informativeness Quantization

Distributed Reinforcement Learning for Privacy-Preserving Dynamic Edge Caching

2021-10-20 · Shengheng Liu, Chong Zheng, Yongming Huang, Tony Q. S. Quek

Mobile edge computing (MEC) is a prominent computing paradigm which expands the application fields of wireless communication. Due to the limitation of the capacities of user equipments and MEC servers, edge caching (EC) …

Edge-computing Federated Learning Privacy Preserving reinforcement-learning+2

Federated TD Learning over Finite-Rate Erasure Channels: Linear Speedup under Markovian Sampling

2023-05-14 · Nicolò Dal Fabbro, Aritra Mitra, George J. Pappas

Federated learning (FL) has recently gained much attention due to its effectiveness in speeding up supervised learning tasks under communication and privacy constraints. However, whether similar speedups can be establish…

Distributed Optimization Federated Learning Quantization reinforcement-learning+1