paper-with-me

홈 › Papers

Energy-efficient Deployment of Deep Learning Applications on Cortex-M based Microcontrollers using Deep Compression

2022-05-20 · Mark Deutel, Philipp Woller, Christopher Mutschler, Jürgen Teich

Large Deep Neural Networks (DNNs) are the backbone of today's artificial intelligence due to their ability to make accurate predictions when being trained on huge datasets. With advancing technologies, such as the Internet of Things, interpreting large quantities of data generated by sensors is becoming an increasingly important task. However, in many applications not only the predictive performance but also the energy consumption of deep learning models is of major interest. This paper investigates the efficient deployment of deep learning models on resource-constrained microcontroller architectures via network compression. We present a methodology for the systematic exploration of different DNN pruning, quantization, and deployment strategies, targeting different ARM Cortex-M based low-power systems. The exploration allows to analyze trade-offs between key metrics such as accuracy, memory consumption, execution time, and power consumption. We discuss experimental results on three different DNN architectures and show that we can compress them to below 10\% of their original parameter count before their predictive quality decreases. This also allows us to deploy and evaluate them on Cortex-M based microcontrollers.

📄 PDF Abstract BibTeX arXiv:2205.10369

Code (0)

등록된 구현이 없습니다.

Tasks

Quantization

Similar Papers 제목 키워드 기반

Deep Microcompression: Structured Pruning and Bit-packed Quantization for Microcontrollers

2026-09-04 · Opegbemi Matthias Busoye, Tolulope Matthew Busoye, Eghonghon-aye Eigbe arxiv

This paper introduces Deep Microcompression (DMC), a hardware-aware pipeline for deep learning inference on bare-metal microcontrollers. DMC integrates structured pruning, quantization-aware training, and fixed-length bi…

FANN-on-MCU: An Open-Source Toolkit for Energy-Efficient Neural Network Inference at the Edge of the Internet of Things

2019-11-08 · Xiaying Wang, Michele Magno, Lukas Cavigelli, Luca Benini

The growing number of low-power smart devices in the Internet of Things is coupled with the concept of "Edge Computing", that is moving some of the intelligence, especially machine learning, towards the edge of the netwo…

BIG-bench Machine LearningEdge-computingEfficient Neural Network

OpTC -- A Toolchain for Deployment of Neural Networks on AURIX TC3xx Microcontrollers

2024-04-24 · Christian Heidorn, Frank Hannig, Dominik Riedelbauch, Christoph Strohmeyer 외

The AURIX 2xx and 3xx families of TriCore microcontrollers are widely used in the automotive industry and, recently, also in applications that involve machine learning tasks. Yet, these applications are mainly engineered…

Code Generation

Evaluation of Convolution Primitives for Embedded Neural Networks on 32-bit Microcontrollers

2023-03-19 · Baptiste Nguyen, Pierre-Alain Moellic, Sylvain Blayac

Deploying neural networks on constrained hardware platforms such as 32-bit microcontrollers is a challenging task because of the large memory, computing and energy requirements of their inference process. To tackle these…

Design-Time Optimization of Deep Neural Networks for Intermittent Learning on Microcontrollers

2026-08-04 · Jakob Schubert, Maximilian Kasper, Maximilian Linke, Benedict Herzog 외 arxiv

We present a method for designing deep neural networks (DNNs) for intermittent, energy-autonomous, on-device learning on microcontroller units (MCUs). In mobile applications where the energy can run out, e.g., when solar…

Anomaly Detection