Goal-Oriented Communication for Edge Learning based on the Information Bottleneck
Whenever communication takes place to fulfil a goal, an effective way to encode the source data to be transmitted is to use an encoding rule that allows the receiver to meet the requirements of the goal. A formal way to identify the relevant information with respect to a goal can be obtained exploiting the information bottleneck (IB) principle. In this paper, we propose a goal-oriented communication system, based on the combination of IB and stochastic optimization. The IB principle is used to design the encoder in order to find an optimal balance between representation complexity and relevance of the encoded data with respect to the goal. Stochastic optimization is then used to adapt the parameters of the IB to find an efficient resource allocation of communication and computation resources. Our goal is to minimize the average energy consumption under constraints on average service delay and accuracy of the learning task applied to the received data in a dynamic scenario. Numerical results assess the performance of the proposed strategy in two cases: regression from Gaussian random variables, where we can exploit closed-form solutions, and image classification using deep neural networks, with adaptive network splitting between transmit and receive sides.
Code (0)
등록된 구현이 없습니다.
Tasks
image-classificationImage ClassificationStochastic OptimizationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Adversarial Robustness of Bottleneck Injected Deep Neural Networks for Task-Oriented Communication
This paper investigates the adversarial robustness of Deep Neural Networks (DNNs) using Information Bottleneck (IB) objectives for task-oriented communication systems. We empirically demonstrate that while IB-based appro…
Adversarial RobustnessGoal-Oriented Wireless Communication Resource Allocation for Cyber-Physical Systems
The proliferation of novel industrial applications at the wireless edge, such as smart grids and vehicle networks, demands the advancement of cyber-physical systems. The performance of CPSs is closely linked to the last-…
Decision MakingDistributed OptimizationFederated LearningGoal-Oriented Semantic Communication for Wireless Visual Question Answering
The rapid progress of artificial intelligence (AI) and computer vision (CV) has facilitated the development of computation-intensive applications like Visual Question Answering (VQA), which integrates visual perception a…
Edge-computingQuestion AnsweringSemantic CommunicationVisual Question Answering+1Task-Oriented Communication for Multi-Device Cooperative Edge Inference
This paper investigates task-oriented communication for multi-device cooperative edge inference, where a group of distributed low-end edge devices transmit the extracted features of local samples to a powerful edge serve…
Learning Task-Oriented Communication for Edge Inference: An Information Bottleneck Approach
This paper investigates task-oriented communication for edge inference, where a low-end edge device transmits the extracted feature vector of a local data sample to a powerful edge server for processing. It is critical t…
Dynamic neural networksInformativeness