Deep Reinforcement Learning for Multi-User RF Charging with Non-linear Energy Harvesters
Radio frequency (RF) wireless power transfer (WPT) is a promising technology for sustainable support of massive Internet of Things (IoT). However, RF-WPT systems are characterized by low efficiency due to channel attenuation, which can be mitigated by precoders that adjust the transmission directivity. This work considers a multi-antenna RF-WPT system with multiple non-linear energy harvesting (EH) nodes with energy demands changing over discrete time slots. This leads to the charging scheduling problem, which involves choosing the precoders at each slot to minimize the total energy consumption and meet the EH requirements. We model the problem as a Markov decision process and propose a solution relying on a low-complexity beamforming and deep deterministic policy gradient (DDPG). The results show that the proposed beamforming achieves near-optimal performance with low computational complexity, and the DDPG-based approach converges with the number of episodes and reduces the system's power consumption, while the outage probability and the power consumption increase with the number of devices.
Code (0)
등록된 구현이 없습니다.
Tasks
Deep Reinforcement LearningSchedulingSimilar Papers 제목 키워드 기반
On-Request Wireless Charging and Partial Computation Offloading In Multi-Access Edge Computing Systems
Wireless charging coupled with computation offloading in edge networks offers a promising solution for realizing power-hungry and computation intensive applications on user devices. We consider a multi-access edge comput…
Edge-computingMARL for Decentralized Electric Vehicle Charging Coordination with V2V Energy Exchange
Effective energy management of electric vehicle (EV) charging stations is critical to supporting the transport sector's sustainable energy transition. This paper addresses the EV charging coordination by considering vehi…
energy managementFairnessManagementMulti-agent Reinforcement LearningSolar Power driven EV Charging Optimization with Deep Reinforcement Learning
Power sector decarbonization plays a vital role in the upcoming energy transition towards a more sustainable future. Decentralized energy resources, such as Electric Vehicles (EV) and solar photovoltaic systems (PV), are…
Deep Reinforcement Learningreinforcement-learningReinforcement LearningReinforcement Learning (RL)Federated Reinforcement Learning for Real-Time Electric Vehicle Charging and Discharging Control
With the recent advances in mobile energy storage technologies, electric vehicles (EVs) have become a crucial part of smart grids. When EVs participate in the demand response program, the charging cost can be significant…
reinforcement-learningReinforcement Learning (RL)Learning a Multi-Agent Controller for Shared Energy Storage System
Deployment of shared energy storage systems (SESS) allows users to use the stored energy to meet their own energy demands while saving energy costs without installing private energy storage equipment. In this paper, we c…
Multi-agent Reinforcement LearningScheduling