Enabling Fast Deep Learning on Tiny Energy-Harvesting IoT Devices
Energy harvesting (EH) IoT devices that operate intermittently without batteries, coupled with advances in deep neural networks (DNNs), have opened up new opportunities for enabling sustainable smart applications. Nevertheless, implementing those computation and memory-intensive intelligent algorithms on EH devices is extremely difficult due to the challenges of limited resources and intermittent power supply that causes frequent failures. To address those challenges, this paper proposes a methodology that enables fast deep learning with low-energy accelerators for tiny energy harvesting devices. We first propose $RAD$, a resource-aware structured DNN training framework, which employs block circulant matrix and structured pruning to achieve high compression for leveraging the advantage of various vector operation accelerators. A DNN implementation method, $ACE$, is then proposed that employs low-energy accelerators to profit maximum performance with small energy consumption. Finally, we further design $FLEX$, the system support for intermittent computation in energy harvesting situations. Experimental results from three different DNN models demonstrate that $RAD$, $ACE$, and $FLEX$ can enable fast and correct inference on energy harvesting devices with up to 4.26X runtime reduction, up to 7.7X energy reduction with higher accuracy over the state-of-the-art.
Code (0)
등록된 구현이 없습니다.
Tasks
Deep LearningQuantizationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
tinyMAN: Lightweight Energy Manager using Reinforcement Learning for Energy Harvesting Wearable IoT Devices
Advances in low-power electronics and machine learning techniques lead to many novel wearable IoT devices. These devices have limited battery capacity and computational power. Thus, energy harvesting from ambient sources…
energy managementManagementReinforcement Learning (RL)On TinyML and Cybersecurity: Electric Vehicle Charging Infrastructure Use Case
As technology advances, the use of Machine Learning (ML) in cybersecurity is becoming increasingly crucial to tackle the growing complexity of cyber threats. While traditional ML models can enhance cybersecurity, their h…
Transfer LearningFast Inventory for 3GPP Ambient IoT Considering Device Unavailability due to Energy Harvesting
With the growing demand for massive internet of things (IoT), new IoT technology, namely ambient IoT (A-IoT), has been studied in the 3rd Generation Partnership Project (3GPP). A-IoT devices are batteryless and consume u…
Zero-energy Devices for 6G: Technical Enablers at a Glance
Low-cost, resource-constrained, maintenance-free, and energy-harvesting (EH) Internet of Things (IoT) devices, referred to as zero-energy devices (ZEDs), are rapidly attracting attention from industry and academia due to…
ManagementSchedulingAnalysis of RF Energy Harvesting in Uplink-NOMA IoT-based Network
Internet of Things (IoT) systems in general consist of a lot of devices with massive connectivity. Those devices are usually constrained with limited energy supply and can only operate at low power and low rate. In this …