Communication-Efficient Edge AI Inference Over Wireless Networks
Given the fast growth of intelligent devices, it is expected that a large number of high-stake artificial intelligence (AI) applications, e.g., drones, autonomous cars, tactile robots, will be deployed at the edge of wireless networks in the near future. As such, the intelligent communication networks will be designed to leverage advanced wireless techniques and edge computing technologies to support AI-enabled applications at various end devices with limited communication, computation, hardware and energy resources. In this article, we shall present the principles of efficient deployment of model inference at network edge to provide low-latency and energy-efficient AI services. This includes the wireless distributed computing framework for low-latency device distributed model inference as well as the wireless cooperative transmission strategy for energy-efficient edge cooperative model inference. The communication efficiency of edge inference systems is further improved by building up a smart radio propagation environment via intelligent reflecting surface.
Code (0)
등록된 구현이 없습니다.
Tasks
Distributed ComputingEdge-computingIntelligent CommunicationSimilar Papers 제목 키워드 기반
Distributed Learning in Wireless Networks: Recent Progress and Future Challenges
The next-generation of wireless networks will enable many machine learning (ML) tools and applications to efficiently analyze various types of data collected by edge devices for inference, autonomy, and decision making p…
Decision MakingFederated LearningMulti-agent Reinforcement LearningAdaptive Early Exiting for Collaborative Inference over Noisy Wireless Channels
Collaborative inference systems are one of the emerging solutions for deploying deep neural networks (DNNs) at the wireless network edge. Their main idea is to divide a DNN into two parts, where the first is shallow enou…
Collaborative Inferenceimage-classificationImage ClassificationNeuromorphic Wireless Device-Edge Co-Inference via the Directed Information Bottleneck
An important use case of next-generation wireless systems is device-edge co-inference, where a semantic task is partitioned between a device and an edge server. The device carries out data collection and partial processi…
Communication-Efficient Multi-Modal Edge Inference via Uncertainty-Aware Distributed Learning
Semantic communication is emerging as a key enabler for distributed edge intelligence due to its capability to convey task-relevant meaning. However, achieving communication-efficient training and robust inference over w…
Self-Supervised LearningSemantic CommunicationScene ClassificationGoing Beyond the Edge: Distributed Inference of Transformer Models on Ultra-Low-Power Wireless Devices
Transformer models are rapidly becoming a cornerstone of modern Internet of Things (IoT) applications, yet their computational and memory demands far exceed the capabilities of a single typical ultra-low-power IoT device…