paper-with-me

Papers

I-SplitEE: Image classification in Split Computing DNNs with Early Exits

2024-01-19 · Divya Jyoti Bajpai, Aastha Jaiswal, Manjesh Kumar Hanawal

The recent advances in Deep Neural Networks (DNNs) stem from their exceptional performance across various domains. However, their inherent large size hinders deploying these networks on resource-constrained devices like edge, mobile, and IoT platforms. Strategies have emerged, from partial cloud computation offloading (split computing) to integrating early exits within DNN layers. Our work presents an innovative unified approach merging early exits and split computing. We determine the 'splitting layer', the optimal depth in the DNN for edge device computations, and whether to infer on edge device or be offloaded to the cloud for inference considering accuracy, computational efficiency, and communication costs. Also, Image classification faces diverse environmental distortions, influenced by factors like time of day, lighting, and weather. To adapt to these distortions, we introduce I-SplitEE, an online unsupervised algorithm ideal for scenarios lacking ground truths and with sequential data. Experimental validation using Caltech-256 and Cifar-10 datasets subjected to varied distortions showcases I-SplitEE's ability to reduce costs by a minimum of 55% with marginal performance degradation of at most 5%.

📄 PDF Abstract BibTeX arXiv:2401.10541

Code (1)

Div290/I-SplitEE 공식 구현 pytorch

Tasks

Computational Efficiencyimage-classificationImage Classification

Similar Papers 제목 키워드 기반

SplitEE: Early Exit in Deep Neural Networks with Split Computing

2023-09-17 · Divya J. Bajpai, Vivek K. Trivedi, Sohan L. Yadav, Manjesh K. Hanawal

Deep Neural Networks (DNNs) have drawn attention because of their outstanding performance on various tasks. However, deploying full-fledged DNNs in resource-constrained devices (edge, mobile, IoT) is difficult due to the…

Natural Language InferenceParaphrase Identification

Salted Inference: Enhancing Privacy while Maintaining Efficiency of Split Inference in Mobile Computing

2023-10-20 · Mohammad Malekzadeh, Fahim Kawsar

In split inference, a deep neural network (DNN) is partitioned to run the early part of the DNN at the edge and the later part of the DNN in the cloud. This meets two key requirements for on-device machine learning: inpu…

Hetero-SplitEE: Split Learning of Neural Networks with Early Exits for Heterogeneous IoT Devices

2025-12-10 · Yuki Oda, Yuta Ono, Hiroshi Nakamura, Hideki Takase arxiv

The continuous scaling of deep neural networks has fundamentally transformed machine learning, with larger models demonstrating improved performance across diverse tasks. This growth in model size has dramatically increa…

Federated Learning

SplitNets: Designing Neural Architectures for Efficient Distributed Computing on Head-Mounted Systems

2022-04-10 · CVPR 2022 1 · Xin Dong, Barbara De Salvo, Meng Li, Chiao Liu 외

We design deep neural networks (DNNs) and corresponding networks' splittings to distribute DNNs' workload to camera sensors and a centralized aggregator on head mounted devices to meet system performance targets in infer…

3D ClassificationDistributed ComputingNeural Architecture Search

Dynamic Split Computing for Efficient Deep Edge Intelligence

2022-05-23 · Arian Bakhtiarnia, Nemanja Milošević, Qi Zhang, Dragana Bajović 외

Deploying deep neural networks (DNNs) on IoT and mobile devices is a challenging task due to their limited computational resources. Thus, demanding tasks are often entirely offloaded to edge servers which can accelerate …

Edge-computingHyperparameter Optimization