Federated Learning over Wireless Device-to-Device Networks: Algorithms and Convergence Analysis

2021-01-29 · Hong Xing, Osvaldo Simeone, Suzhi Bi

The proliferation of Internet-of-Things (IoT) devices and cloud-computing applications over siloed data centers is motivating renewed interest in the collaborative training of a shared model by multiple individual clients via federated learning (FL). To improve the communication efficiency of FL implementations in wireless systems, recent works have proposed compression and dimension reduction mechanisms, along with digital and analog transmission schemes that account for channel noise, fading, and interference. The prior art has mainly focused on star topologies consisting of distributed clients and a central server. In contrast, this paper studies FL over wireless device-to-device (D2D) networks by providing theoretical insights into the performance of digital and analog implementations of decentralized stochastic gradient descent (DSGD). First, we introduce generic digital and analog wireless implementations of communication-efficient DSGD algorithms, leveraging random linear coding (RLC) for compression and over-the-air computation (AirComp) for simultaneous analog transmissions. Next, under the assumptions of convexity and connectivity, we provide convergence bounds for both implementations. The results demonstrate the dependence of the optimality gap on the connectivity and on the signal-to-noise ratio (SNR) levels in the network. The analysis is corroborated by experiments on an image-classification task.

📄 PDF Abstract BibTeX arXiv:2101.12704

Code (0)

등록된 구현이 없습니다.

Tasks

Cloud ComputingDimensionality Reduction Federated Learning image-classification Image Classification

Towards Energy Efficient Federated Learning over 5G+ Mobile Devices

2021-01-13 · Dian Shi, Liang Li, Rui Chen, Pavana Prakash 외

The continuous convergence of machine learning algorithms, 5G and beyond (5G+) wireless communications, and artificial intelligence (AI) hardware implementation hastens the birth of federated learning (FL) over 5G+ mobil…

Federated Learning GPU Quantization

Federated Inference with Reliable Uncertainty Quantification over Wireless Channels via Conformal Prediction

2023-08-08 · Meiyi Zhu, Matteo Zecchin, Sangwoo Park, Caili Guo 외

In this paper, we consider a wireless federated inference scenario in which devices and a server share a pre-trained machine learning model. The devices communicate statistical information about their local data to the s…

Conformal Prediction Uncertainty Quantification

Federated Learning in Unreliable and Resource-Constrained Cellular Wireless Networks

2020-12-09 · Mohammad Salehi, Ekram Hossain

With growth in the number of smart devices and advancements in their hardware, in recent years, data-driven machine learning techniques have drawn significant attention. However, due to privacy and communication issues, …

BIG-bench Machine Learning Federated Learning Scheduling

Federated Learning over Wireless Networks: A Band-limited Coordinated Descent Approach

2021-02-16 · Junshan Zhang, Na Li, Mehmet Dedeoglu

We consider a many-to-one wireless architecture for federated learning at the network edge, where multiple edge devices collaboratively train a model using local data. The unreliable nature of wireless connectivity, toge…

Federated Learning

Communication-Efficient Federated Learning by Quantized Variance Reduction for Heterogeneous Wireless Edge Networks

2025-01-20 · Shuai Wang, Yanqing Xu, Chaoqun You, Mingjie Shao 외

Federated learning (FL) has been recognized as a viable solution for local-privacy-aware collaborative model training in wireless edge networks, but its practical deployment is hindered by the high communication overhead…

Federated Learning Quantization