Semantics-Driven Cloud-Edge Collaborative Inference

2023-09-27 · Yuche Gao, Beibei Zhang

With the proliferation of video data in smart city applications like intelligent transportation, efficient video analytics has become crucial but also challenging. This paper proposes a semantics-driven cloud-edge collaborative approach for accelerating video inference, using license plate recognition as a case study. The method separates semantics extraction and recognition, allowing edge servers to only extract visual semantics (license plate patches) from video frames and offload computation-intensive recognition to the cloud or neighboring edges based on load. This segmented processing coupled with a load-aware work distribution strategy aims to reduce end-to-end latency and improve throughput. Experiments demonstrate significant improvements in end-to-end inference speed (up to 5x faster), throughput (up to 9 FPS), and reduced traffic volumes (50% less) compared to cloud-only or edge-only processing, validating the efficiency of the proposed approach. The cloud-edge collaborative framework with semantics-driven work partitioning provides a promising solution for scaling video analytics in smart cities.

📄 PDF Abstract BibTeX arXiv:2309.15435

Code (0)

등록된 구현이 없습니다.

Tasks

Collaborative InferenceLicense Plate Recognition

Methods 이 논문이 사용한 방법론

SPEED The monocular depth estimation (MDE) is the task of estimating depth from a single frame. This information is an essential knowledge in many computer vision tasks such as scene…

MemoVAD: Resource-Efficient Video Anomaly Detection via Dynamic Semantic Memory in Edge Computing Scenarios

2026-06-04 · Guo Li, Jiandian Zeng, Yang Li, Zihao Peng 외 arxiv

Deploying Video Anomaly Detection (VAD) in real-world surveillance faces a fundamental tension between the demand for high-level semantics to ensure effectiveness and the limited computational resources of edge devices. …

Video Anomaly Detection

LAST: The Last Query Token Guides Visual Token Pruning for Edge-Cloud Collaborative MLLM Inference

2026-07-30 · Feng Yang, Xinrui Ju, Keyang Zhang, Xiandong Meng 외 arxiv

Multimodal foundation models are reshaping edge-cloud visual intelligence from task-specific feature pipelines into token-based interfaces, where edge devices encode visual inputs into tokens for a general-purpose cloud …

CDC: Classification Driven Compression for Bandwidth Efficient Edge-Cloud Collaborative Deep Learning

2020-05-04 · Yuanrui Dong, Peng Zhao, Hanqiao Yu, Cong Zhao 외

The emerging edge-cloud collaborative Deep Learning (DL) paradigm aims at improving the performance of practical DL implementations in terms of cloud bandwidth consumption, response latency, and data privacy preservation…

Classification General Classification Quantization

DVFO: Learning-Based DVFS for Energy-Efficient Edge-Cloud Collaborative Inference

2023-06-02 · Ziyang Zhang, Yang Zhao, Huan Li, Changyao Lin 외

Due to limited resources on edge and different characteristics of deep neural network (DNN) models, it is a big challenge to optimize DNN inference performance in terms of energy consumption and end-to-end latency on edg…

Collaborative Inference CPU Deep Reinforcement Learning GPU

Auto-tuning Neural Network Quantization Framework for Collaborative Inference Between the Cloud and Edge

2018-12-16 · Guangli Li, Lei Liu, Xueying Wang, Xiao Dong 외

Recently, deep neural networks (DNNs) have been widely applied in mobile intelligent applications. The inference for the DNNs is usually performed in the cloud. However, it leads to a large overhead of transmitting data …

Collaborative Inference Quantization