Asynchronous Decentralized Learning over Unreliable Wireless Networks
Decentralized learning enables edge users to collaboratively train models by exchanging information via device-to-device communication, yet prior works have been limited to wireless networks with fixed topologies and reliable workers. In this work, we propose an asynchronous decentralized stochastic gradient descent (DSGD) algorithm, which is robust to the inherent computation and communication failures occurring at the wireless network edge. We theoretically analyze its performance and establish a non-asymptotic convergence guarantee. Experimental results corroborate our analysis, demonstrating the benefits of asynchronicity and outdated gradient information reuse in decentralized learning over unreliable wireless networks.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
DRACO: Decentralized Asynchronous Federated Learning over Row-Stochastic Wireless Networks
Recent developments and emerging use cases, such as smart Internet of Things (IoT) and Edge AI, have sparked considerable interest in the training of neural networks over fully decentralized (serverless) networks. One of…
Federated LearningAsynchronous Decentralized Federated Learning over Lossy Wireless Links via Reception- and Age-Aware Aggregation
Decentralized Federated Learning(DFL) enables collaborative model training across wireless edge nodes, including IoT deployments, autonomous vehicles, UAV swarms, and satellite constellations. Operating over lossy wirele…
Autonomous VehiclesFederated LearningResilient Decentralized Wireless Federated Learning via Gradient Tracking with AdamW
Wireless Internet-of-Things (IoT) edge networks require decentralized learning (DecL) methods that can operate reliably under both heterogeneous local data and communication-constrained wireless links. However, existing …
Federated LearningTime-triggered Federated Learning over Wireless Networks
The newly emerging federated learning (FL) framework offers a new way to train machine learning models in a privacy-preserving manner. However, traditional FL algorithms are based on an event-triggered aggregation, which…
Federated LearningPrivacy PreservingLearning Decentralized Wireless Resource Allocations with Graph Neural Networks
We consider the broad class of decentralized optimal resource allocation problems in wireless networks, which can be formulated as a constrained statistical learning problems with a localized information structure. We de…