A proximal policy optimization based intelligent home solar management
In the smart grid, the prosumers can sell unused electricity back to the power grid, assuming the prosumers own renewable energy sources and storage units. The maximizing of their profits under a dynamic electricity market is a problem that requires intelligent planning. To address this, we propose a framework based on Proximal Policy Optimization (PPO) using recurrent rewards. By using the information about the rewards modeled effectively with PPO to maximize our objective, we were able to get over 30\% improvement over the other naive algorithms in accumulating total profits. This shows promise in getting reinforcement learning algorithms to perform tasks required to plan their actions in complex domains like financial markets. We also introduce a novel method for embedding longs based on soliton waves that outperformed normal embedding in our use case with random floating point data augmentation.
Code (0)
등록된 구현이 없습니다.
Tasks
Data AugmentationManagementMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Distributed Proximal Policy Optimization for Contention-Based Spectrum Access
The increasing number of wireless devices operating in unlicensed spectrum motivates the development of intelligent adaptive approaches to spectrum access that go beyond traditional carrier sensing. We develop a novel di…
FairnessOptimizing Day-Ahead Energy Trading with Proximal Policy Optimization and Blockchain
The increasing penetration of renewable energy sources in day-ahead energy markets introduces challenges in balancing supply and demand, ensuring grid resilience, and maintaining trust in decentralized trading systems. T…
Reinforcement LearningSmart Home Energy Management System for Power System Resiliency
The need for resiliency of electricity supply is increasing due to increasing frequency of natural disasters---such as hurricanes---that disrupt supply from the power grid. Rooftop solar photovoltaic (PV) panels together…
Decision Makingenergy managementManagementModel Predictive ControlOptimizing a domestic battery and solar photovoltaic system with deep reinforcement learning
A lowering in the cost of batteries and solar PV systems has led to a high uptake of solar battery home systems. In this work, we use the deep deterministic policy gradient algorithm to optimise the charging and discharg…
Deep Reinforcement Learningreinforcement-learningReinforcement Learning (RL)Securely implementing and managing neighborhood solar with storage and peer to peer transactive energy
In this paper, we aim to leverage peer to peer (P2P) transactive energy framework for optimal control of rooftop or neighborhood solar power with battery electric storage systems (BESS). Here we propose that the multiple…