paper-with-me

Papers

A Converting Autoencoder Toward Low-latency and Energy-efficient DNN Inference at the Edge

2024-03-11 · Hasanul Mahmud, Peng Kang, Kevin Desai, Palden Lama, Sushil Prasad

Reducing inference time and energy usage while maintaining prediction accuracy has become a significant concern for deep neural networks (DNN) inference on resource-constrained edge devices. To address this problem, we propose a novel approach based on "converting" autoencoder and lightweight DNNs. This improves upon recent work such as early-exiting framework and DNN partitioning. Early-exiting frameworks spend different amounts of computation power for different input data depending upon their complexity. However, they can be inefficient in real-world scenarios that deal with many hard image samples. On the other hand, DNN partitioning algorithms that utilize the computation power of both the cloud and edge devices can be affected by network delays and intermittent connections between the cloud and the edge. We present CBNet, a low-latency and energy-efficient DNN inference framework tailored for edge devices. It utilizes a "converting" autoencoder to efficiently transform hard images into easy ones, which are subsequently processed by a lightweight DNN for inference. To the best of our knowledge, such autoencoder has not been proposed earlier. Our experimental results using three popular image-classification datasets on a Raspberry Pi 4, a Google Cloud instance, and an instance with Nvidia Tesla K80 GPU show that CBNet achieves up to 4.8x speedup in inference latency and 79% reduction in energy usage compared to competing techniques while maintaining similar or higher accuracy.

📄 PDF Abstract BibTeX arXiv:2403.07036

Code (0)

등록된 구현이 없습니다.

Tasks

GPUimage-classificationImage ClassificationRaspberry Pi 4

Methods 이 논문이 사용한 방법론

CBNet CBNet is a backbone architecture that consists of multiple identical backbones (specially called Assistant Backbones and Lead Backbone) and composite connections between…

Similar Papers 제목 키워드 기반

EncodeNet: A Framework for Boosting DNN Accuracy with Entropy-driven Generalized Converting Autoencoder

2024-04-21 · Hasanul Mahmud, Kevin Desai, Palden Lama, Sushil K. Prasad

Image classification is a fundamental task in computer vision, and the quest to enhance DNN accuracy without inflating model size or latency remains a pressing concern. We make a couple of advances in this regard, leadin…

image-classificationImage ClassificationKnowledge Distillation

Multi-Agent Collaborative Inference via DNN Decoupling: Intermediate Feature Compression and Edge Learning

2022-05-24 · Zhiwei Hao, Guanyu Xu, Yong Luo, Han Hu 외

Recently, deploying deep neural network (DNN) models via collaborative inference, which splits a pre-trained model into two parts and executes them on user equipment (UE) and edge server respectively, becomes attractive.…

Collaborative InferenceCPUFeature Compression

Low Latency Conversion of Artificial Neural Network Models to Rate-encoded Spiking Neural Networks

2022-10-27 · Zhanglu Yan, Jun Zhou, Weng-Fai Wong

Spiking neural networks (SNNs) are well suited for resource-constrained applications as they do not need expensive multipliers. In a typical rate-encoded SNN, a series of binary spikes within a globally fixed time window…

Precision-aware Latency and Energy Balancing on Multi-Accelerator Platforms for DNN Inference

2023-06-08 · Matteo Risso, Alessio Burrello, Giuseppe Maria Sarda, Luca Benini 외

The need to execute Deep Neural Networks (DNNs) at low latency and low power at the edge has spurred the development of new heterogeneous Systems-on-Chips (SoCs) encapsulating a diverse set of hardware accelerators. How …

Quantization

EdgeRL: Reinforcement Learning-driven Deep Learning Model Inference Optimization at Edge

2024-10-16 · Motahare Mounesan, Xiaojie Zhang, Saptarshi Debroy

Balancing mutually diverging performance metrics, such as, processing latency, outcome accuracy, and end device energy consumption is a challenging undertaking for deep learning model inference in ad-hoc edge environment…

Deep LearningInference OptimizationReinforcement Learning (RL)