Accelerating Federated Learning over Reliability-Agnostic Clients in Mobile Edge Computing Systems

2020-07-28 · Wentai Wu, Ligang He, Weiwei Lin, Rui Mao

Mobile Edge Computing (MEC), which incorporates the Cloud, edge nodes and end devices, has shown great potential in bringing data processing closer to the data sources. Meanwhile, Federated learning (FL) has emerged as a promising privacy-preserving approach to facilitating AI applications. However, it remains a big challenge to optimize the efficiency and effectiveness of FL when it is integrated with the MEC architecture. Moreover, the unreliable nature (e.g., stragglers and intermittent drop-out) of end devices significantly slows down the FL process and affects the global model's quality Xin such circumstances. In this paper, a multi-layer federated learning protocol called HybridFL is designed for the MEC architecture. HybridFL adopts two levels (the edge level and the cloud level) of model aggregation enacting different aggregation strategies. Moreover, in order to mitigate stragglers and end device drop-out, we introduce regional slack factors into the stage of client selection performed at the edge nodes using a probabilistic approach without identifying or probing the state of end devices (whose reliability is agnostic). We demonstrate the effectiveness of our method in modulating the proportion of clients selected and present the convergence analysis for our protocol. We have conducted extensive experiments with machine learning tasks in different scales of MEC system. The results show that HybridFL improves the FL training process significantly in terms of shortening the federated round length, speeding up the global model's convergence (by up to 12X) and reducing end device energy consumption (by up to 58%).

📄 PDF Abstract BibTeX arXiv:2007.14374

Code (0)

등록된 구현이 없습니다.

Tasks

Edge-computingFederated LearningPrivacy Preserving

Communication-Efficient Agnostic Federated Averaging

2021-04-06 · Jae Ro, Mingqing Chen, Rajiv Mathews, Mehryar Mohri 외

In distributed learning settings such as federated learning, the training algorithm can be potentially biased towards different clients. Mohri et al. (2019) proposed a domain-agnostic learning algorithm, where the model …

Federated Learning Language Modeling Language Modelling

Dynamic Fusion based Federated Learning for COVID-19 Detection

2020-09-22 · Weishan Zhang, Tao Zhou, Qinghua Lu, Xiao Wang 외

Medical diagnostic image analysis (e.g., CT scan or X-Ray) using machine learning is an efficient and accurate way to detect COVID-19 infections. However, sharing diagnostic images across medical institutions is usually …

BIG-bench Machine Learning Decision Making Diagnostic Federated Learning+3

FedIFL: A federated cross-domain diagnostic framework for motor-driven systems with inconsistent fault modes

2025-05-12 · Zexiao Wang, Yankai Wang, Xiaoqiang Liao, Xinguo Ming 외

Due to the scarcity of industrial data, individual equipment users, particularly start-ups, struggle to independently train a comprehensive fault diagnosis model; federated learning enables collaborative training while e…

Contrastive Learning Diagnostic Disentanglement Fault Diagnosis+1

Federated Reconstruction: Partially Local Federated Learning

2021-02-05 · NeurIPS 2021 12 · Karan Singhal, Hakim Sidahmed, Zachary Garrett, Shanshan Wu 외

Personalization methods in federated learning aim to balance the benefits of federated and local training for data availability, communication cost, and robustness to client heterogeneity. Approaches that require clients…

Collaborative Filtering Federated Learning Meta-Learning

RSCFed: Random Sampling Consensus Federated Semi-supervised Learning

2022-03-26 · CVPR 2022 1 · Xiaoxiao Liang, Yiqun Lin, Huazhu Fu, Lei Zhu 외

Federated semi-supervised learning (FSSL) aims to derive a global model by training fully-labeled and fully-unlabeled clients or training partially labeled clients. The existing approaches work well when local clients ha…

Federated Learning