paper-with-me

Papers

Collaborative Edge AI Inference over Cloud-RAN

2024-04-09 · Pengfei Zhang, Dingzhu Wen, Guangxu Zhu, Qimei Chen, Kaifeng Han, Yuanming Shi

In this paper, a cloud radio access network (Cloud-RAN) based collaborative edge AI inference architecture is proposed. Specifically, geographically distributed devices capture real-time noise-corrupted sensory data samples and extract the noisy local feature vectors, which are then aggregated at each remote radio head (RRH) to suppress sensing noise. To realize efficient uplink feature aggregation, we allow each RRH receives local feature vectors from all devices over the same resource blocks simultaneously by leveraging an over-the-air computation (AirComp) technique. Thereafter, these aggregated feature vectors are quantized and transmitted to a central processor (CP) for further aggregation and downstream inference tasks. Our aim in this work is to maximize the inference accuracy via a surrogate accuracy metric called discriminant gain, which measures the discernibility of different classes in the feature space. The key challenges lie on simultaneously suppressing the coupled sensing noise, AirComp distortion caused by hostile wireless channels, and the quantization error resulting from the limited capacity of fronthaul links. To address these challenges, this work proposes a joint transmit precoding, receive beamforming, and quantization error control scheme to enhance the inference accuracy. Extensive numerical experiments demonstrate the effectiveness and superiority of our proposed optimization algorithm compared to various baselines.

📄 PDF Abstract BibTeX arXiv:2404.06007

Code (0)

등록된 구현이 없습니다.

Tasks

Quantization

Similar Papers 제목 키워드 기반

DVFO: Learning-Based DVFS for Energy-Efficient Edge-Cloud Collaborative Inference

2023-06-02 · Ziyang Zhang, Yang Zhao, Huan Li, Changyao Lin 외

Due to limited resources on edge and different characteristics of deep neural network (DNN) models, it is a big challenge to optimize DNN inference performance in terms of energy consumption and end-to-end latency on edg…

Collaborative InferenceCPUDeep Reinforcement LearningGPU

Auto-tuning Neural Network Quantization Framework for Collaborative Inference Between the Cloud and Edge

2018-12-16 · Guangli Li, Lei Liu, Xueying Wang, Xiao Dong 외

Recently, deep neural networks (DNNs) have been widely applied in mobile intelligent applications. The inference for the DNNs is usually performed in the cloud. However, it leads to a large overhead of transmitting data …

Collaborative InferenceQuantization

EC-Diff: Fast and High-Quality Edge-Cloud Collaborative Inference for Diffusion Models

2025-07-16 · Jiajian Xie, Shengyu Zhang, Zhou Zhao, Fan Wu 외 arxiv

Diffusion Models have shown remarkable proficiency in image and video synthesis. As model size and latency increase limit user experience, hybrid edge-cloud collaborative framework was recently proposed to realize fast i…

Noise Estimation

Hybrid SD: Edge-Cloud Collaborative Inference for Stable Diffusion Models

2024-08-13 · Chenqian Yan, Songwei Liu, Hongjian Liu, Xurui Peng 외

Stable Diffusion Models (SDMs) have shown remarkable proficiency in image synthesis. However, their broad application is impeded by their large model sizes and intensive computational requirements, which typically requir…

Collaborative InferenceDiversityImage Generation

Semantics-Driven Cloud-Edge Collaborative Inference

2023-09-27 · Yuche Gao, Beibei Zhang

With the proliferation of video data in smart city applications like intelligent transportation, efficient video analytics has become crucial but also challenging. This paper proposes a semantics-driven cloud-edge collab…

Collaborative InferenceLicense Plate Recognition