paper-with-me

홈 › Papers

tinyMAN: Lightweight Energy Manager using Reinforcement Learning for Energy Harvesting Wearable IoT Devices

2022-02-18 · Toygun Basaklar, Yigit Tuncel, Umit Y. Ogras

Advances in low-power electronics and machine learning techniques lead to many novel wearable IoT devices. These devices have limited battery capacity and computational power. Thus, energy harvesting from ambient sources is a promising solution to power these low-energy wearable devices. They need to manage the harvested energy optimally to achieve energy-neutral operation, which eliminates recharging requirements. Optimal energy management is a challenging task due to the dynamic nature of the harvested energy and the battery energy constraints of the target device. To address this challenge, we present a reinforcement learning-based energy management framework, tinyMAN, for resource-constrained wearable IoT devices. The framework maximizes the utilization of the target device under dynamic energy harvesting patterns and battery constraints. Moreover, tinyMAN does not rely on forecasts of the harvested energy which makes it a prediction-free approach. We deployed tinyMAN on a wearable device prototype using TensorFlow Lite for Micro thanks to its small memory footprint of less than 100 KB. Our evaluations show that tinyMAN achieves less than 2.36 ms and 27.75 $\mu$J while maintaining up to 45% higher utility compared to prior approaches.

📄 PDF Abstract BibTeX arXiv:2202.09297

Code (0)

등록된 구현이 없습니다.

Tasks

energy managementManagementReinforcement Learning (RL)

Similar Papers 제목 키워드 기반

Multi-Agent Reinforcement Learning for Energy Networks: Computational Challenges, Progress and Open Problems

2024-04-24 · Sarah Keren, Chaimaa Essayeh, Stefano V. Albrecht, Thomas Morstyn

The rapidly changing architecture and functionality of electrical networks and the increasing penetration of renewable and distributed energy resources have resulted in various technological and managerial challenges. Th…

Multi-agent Reinforcement Learning

InsightBuild: LLM-Powered Causal Reasoning in Smart Building Systems

2025-07-11 · Pinaki Prasad Guha Neogi, Ahmad Mohammadshirazi, Rajiv Ramnath arxiv

Smart buildings generate vast streams of sensor and control data, but facility managers often lack clear explanations for anomalous energy usage. We propose InsightBuild, a two-stage framework that integrates causality a…

Causal Inference

BuildingGym: An open-source toolbox for AI-based building energy management using reinforcement learning

2025-09-15 · Xilei Dai, Ruotian Chen, Songze Guan, Wen-Tai Li 외 arxiv

Reinforcement learning (RL) has proven effective for AI-based building energy management. However, there is a lack of flexible framework to implement RL across various control problems in building energy management. To a…

Reinforcement Learning

An Online Scheduling Algorithm for a Community Energy Storage System

2021-10-05 · Nathaniel Tucker, Mahnoosh Alizadeh

In this paper, we consider a community energy storage (CES) system that is shared by various electricity consumers who want to charge and discharge the CES throughout a given time span. We study the problem facing the ma…

Scheduling

CARMA: Collocation-Aware Resource Manager

2025-08-26 · Ehsan Yousefzadeh-Asl-Miandoab, Florina M. Ciorba, Pınar Tözün arxiv

GPUs running deep learning (DL) workloads are frequently underutilized. Collocating multiple DL training tasks on the same GPU can improve utilization but introduces two key risks: (1) out-of-memory (OOM) crashes for new…