Scaling Configuration of Energy Harvesting Sensors with Reinforcement Learning
With the advent of the Internet of Things (IoT), an increasing number of energy harvesting methods are being used to supplement or supplant battery based sensors. Energy harvesting sensors need to be configured according to the application, hardware, and environmental conditions to maximize their usefulness. As of today, the configuration of sensors is either manual or heuristics based, requiring valuable domain expertise. Reinforcement learning (RL) is a promising approach to automate configuration and efficiently scale IoT deployments, but it is not yet adopted in practice. We propose solutions to bridge this gap: reduce the training phase of RL so that nodes are operational within a short time after deployment and reduce the computational requirements to scale to large deployments. We focus on configuration of the sampling rate of indoor solar panel based energy harvesting sensors. We created a simulator based on 3 months of data collected from 5 sensor nodes subject to different lighting conditions. Our simulation results show that RL can effectively learn energy availability patterns and configure the sampling rate of the sensor nodes to maximize the sensing data while ensuring that energy storage is not depleted. The nodes can be operational within the first day by using our methods. We show that it is possible to reduce the number of RL policies by using a single policy for nodes that share similar lighting conditions.
Code (0)
등록된 구현이 없습니다.
Tasks
reinforcement-learningReinforcement LearningReinforcement Learning (RL)Similar Papers 제목 키워드 기반
ACES -- Automatic Configuration of Energy Harvesting Sensors with Reinforcement Learning
Internet of Things forms the backbone of modern building applications. Wireless sensors are being increasingly adopted for their flexibility and reduced cost of deployment. However, most wireless sensors are powered by b…
reinforcement-learningReinforcement LearningReinforcement Learning (RL)Transfer LearningAge-Aware Status Update Control for Energy Harvesting IoT Sensors via Reinforcement Learning
We consider an IoT sensing network with multiple users, multiple energy harvesting sensors, and a wireless edge node acting as a gateway between the users and sensors. The users request for updates about the value of phy…
reinforcement-learningReinforcement LearningReinforcement Learning (RL)Energy Management in a Cooperative Energy Harvesting Wireless Sensor Network
In this paper, we consider the problem of finding an optimal energy management policy for a network of sensor nodes capable of harvesting their own energy and sharing it with other nodes in the network. We formulate this…
energy managementManagementReview of Contemporary Energy Harvesting Techniques and Their Feasibility in Wireless Geophones
Energy harvesting converts ambient energy to electrical energy providing numerous opportunities to realize wireless sensors. Seismic exploration is a prime avenue to benefit from it as energy harvesting equipped geophone…
Low-cost sensors for indoor PV energy harvesting estimation based on machine learning
With the number of communicating sensors linked to the Internet of Things (IoT) ecosystem in-creasing dramatically, well-designed indoor light energy harvesting solutions are needed. The first step towards this developme…