Communication-Efficient Split Learning Based on Analog Communication and Over the Air Aggregation
Split-learning (SL) has recently gained popularity due to its inherent privacy-preserving capabilities and ability to enable collaborative inference for devices with limited computational power. Standard SL algorithms assume an ideal underlying digital communication system and ignore the problem of scarce communication bandwidth. However, for a large number of agents, limited bandwidth resources, and time-varying communication channels, the communication bandwidth can become the bottleneck. To address this challenge, in this work, we propose a novel SL framework to solve the remote inference problem that introduces an additional layer at the agent side and constrains the choices of the weights and the biases to ensure over the air aggregation. Hence, the proposed approach maintains constant communication cost with respect to the number of agents enabling remote inference under limited bandwidth. Numerical results show that our proposed algorithm significantly outperforms the digital implementation in terms of communication-efficiency, especially as the number of agents grows large.
Code (0)
등록된 구현이 없습니다.
Tasks
Collaborative InferencePrivacy PreservingSimilar Papers 제목 키워드 기반
Spatial Path Index Modulation in mmWave/THz-Band Integrated Sensing and Communications
As the demand for wireless connectivity continues to soar, the fifth generation and beyond wireless networks are exploring new ways to efficiently utilize the wireless spectrum and reduce hardware costs. One such approac…
ISACRate-Splitting Multiple Access for Joint Radar-Communications with Low-Resolution DACs
In this paper, we introduce the design of a multi-antenna Joint Radar-Communication (JRC) system with Rate Splitting Multiple Access (RSMA) and low resolution Digital-to-Analog Converter (DAC) units. Using RSMA, the comm…
Joint Radar-CommunicationJoint Optimization of Communications and Federated Learning Over the Air
Federated learning (FL) is an attractive paradigm for making use of rich distributed data while protecting data privacy. Nonetheless, nonideal communication links and limited transmission resources may hinder the impleme…
Federated LearningCollaborative Split Federated Learning with Parallel Training and Aggregation
Federated learning (FL) operates based on model exchanges between the server and the clients, and it suffers from significant client-side computation and communication burden. Split federated learning (SFL) arises a prom…
Federated LearningNear-Field Wideband Secure Communications: An Analog Beamfocusing Approach
In the rapidly advancing landscape of 6G, characterized by ultra-high-speed wideband transmission in millimeter-wave and terahertz bands, our paper addresses the pivotal task of enhancing physical layer security (PLS) wi…