GlueFL: Reconciling Client Sampling and Model Masking for Bandwidth Efficient Federated Learning
Federated learning (FL) is an effective technique to directly involve edge devices in machine learning training while preserving client privacy. However, the substantial communication overhead of FL makes training challenging when edge devices have limited network bandwidth. Existing work to optimize FL bandwidth overlooks downstream transmission and does not account for FL client sampling. In this paper we propose GlueFL, a framework that incorporates new client sampling and model compression algorithms to mitigate low download bandwidths of FL clients. GlueFL prioritizes recently used clients and bounds the number of changed positions in compression masks in each round. Across three popular FL datasets and three state-of-the-art strategies, GlueFL reduces downstream client bandwidth by 27% on average and reduces training time by 29% on average.
Code (0)
등록된 구현이 없습니다.
Tasks
Federated LearningModel CompressionSimilar Papers 제목 키워드 기반
Rollout event-triggered control: reconciling event- and time-triggered control
Event-triggered control (ETC) and time-triggered control (TTC), the classical concepts to determine the transmission instants for networked control systems, each come with drawbacks: It is difficult to tune ETC such that…
SchedulingAdaptive Heterogeneous Client Sampling for Federated Learning over Wireless Networks
Federated learning (FL) algorithms usually sample a fraction of clients in each round (partial participation) when the number of participants is large and the server's communication bandwidth is limited. Recent works on …
Federated LearningReconciling Security and Communication Efficiency in Federated Learning
Cross-device Federated Learning is an increasingly popular machine learning setting to train a model by leveraging a large population of client devices with high privacy and security guarantees. However, communication ef…
Federated LearningQuantizationA low complexity and high modularity design for continuously variable bandwidth digital filters
Digital filters with variable bandwidth can be used for a variety of applications. Arbitrary change in the bandwidth of a digital Finite Impulse Response (FIR) filter can be acquired using sampling rate converters. In th…
Active Federated Learning
Federated Learning allows for population level models to be trained without centralizing client data by transmitting the global model to clients, calculating gradients locally, then averaging the gradients. Downloading m…
Federated Learning