paper-with-me

Papers

SC2 Benchmark: Supervised Compression for Split Computing

2022-03-16 · Yoshitomo Matsubara, Ruihan Yang, Marco Levorato, Stephan Mandt

With the increasing demand for deep learning models on mobile devices, splitting neural network computation between the device and a more powerful edge server has become an attractive solution. However, existing split computing approaches often underperform compared to a naive baseline of remote computation on compressed data. Recent studies propose learning compressed representations that contain more relevant information for supervised downstream tasks, showing improved tradeoffs between compressed data size and supervised performance. However, existing evaluation metrics only provide an incomplete picture of split computing. This study introduces supervised compression for split computing (SC2) and proposes new evaluation criteria: minimizing computation on the mobile device, minimizing transmitted data size, and maximizing model accuracy. We conduct a comprehensive benchmark study using 10 baseline methods, three computer vision tasks, and over 180 trained models, and discuss various aspects of SC2. We also release sc2bench, a Python package for future research on SC2. Our proposed metrics and package will help researchers better understand the tradeoffs of supervised compression in split computing.

📄 PDF Abstract BibTeX arXiv:2203.08875

Code (1)

yoshitomo-matsubara/sc2-benchmark 공식 구현 pytorch

Tasks

Data CompressionEdge-computingFeature CompressionImage CompressionKnowledge Distillation

Methods 이 논문이 사용한 방법론

Knowledge Distillation A very simple way to improve the performance of almost any machine learning algorithm is to train many different models on the same data and then to average their predictions.…

Similar Papers 제목 키워드 기반

A Multi-task Supervised Compression Model for Split Computing

2025-01-02 · Yoshitomo Matsubara, Matteo Mendula, Marco Levorato

Split computing ($\neq$ split learning) is a promising approach to deep learning models for resource-constrained edge computing systems, where weak sensor (mobile) devices are wirelessly connected to stronger edge server…

Edge-computingimage-classificationImage Classificationobject-detection+2

Supervised Compression for Resource-Constrained Edge Computing Systems

2021-08-21 · Yoshitomo Matsubara, Ruihan Yang, Marco Levorato, Stephan Mandt

There has been much interest in deploying deep learning algorithms on low-powered devices, including smartphones, drones, and medical sensors. However, full-scale deep neural networks are often too resource-intensive in …

Data CompressionEdge-computingFeature CompressionImage Compression+1

A Low-Complexity Approach to Rate-Distortion Optimized Variable Bit-Rate Compression for Split DNN Computing

2022-08-24 · Parual Datta, Nilesh Ahuja, V. Srinivasa Somayazulu, Omesh Tickoo

Split computing has emerged as a recent paradigm for implementation of DNN-based AI workloads, wherein a DNN model is split into two parts, one of which is executed on a mobile/client device and the other on an edge-serv…

Data Compression

Range Asymmetric Numeral Systems-Based Lightweight Intermediate Feature Compression for Split Computing of Deep Neural Networks

2025-11-11 · Mingyu Sung, Suhwan Im, Vikas Palakonda, Jae-Mo Kang arxiv

Split computing distributes deep neural network inference between resource-constrained edge devices and cloud servers but faces significant communication bottlenecks when transmitting intermediate features. To this end, …

Neural Rate Estimator and Unsupervised Learning for Efficient Distributed Image Analytics in Split-DNN Models

2023-01-01 · CVPR 2023 1 · Nilesh Ahuja, Parual Datta, Bhavya Kanzariya, V. Srinivasa Somayazulu 외

Thanks to advances in computer vision and AI, there has been a large growth in the demand for cloud-based visual analytics in which images captured by a low-powered edge device are transmitted to the cloud for analyt…

image-classificationImage ClassificationSemantic Segmentation