Data-driven battery operation for energy arbitrage using rainbow deep reinforcement learning
As the world seeks to become more sustainable, intelligent solutions are needed to increase the penetration of renewable energy. In this paper, the model-free deep reinforcement learning algorithm Rainbow Deep Q-Networks is used to control a battery in a small microgrid to perform energy arbitrage and more efficiently utilise solar and wind energy sources. The grid operates with its own demand and renewable generation based on a dataset collected at Keele University, as well as using dynamic energy pricing from a real wholesale energy market. Four scenarios are tested including using demand and price forecasting produced with local weather data. The algorithm and its subcomponents are evaluated against two continuous control benchmarks with Rainbow able to outperform all other method. This research shows the importance of using the distributional approach for reinforcement learning when working with complex environments and reward functions, as well as how it can be used to visualise and contextualise the agent's behaviour for real-world applications.
Code (0)
등록된 구현이 없습니다.
Tasks
continuous-controlContinuous ControlDeep Reinforcement Learningreinforcement-learningReinforcement LearningReinforcement Learning (RL)Similar Papers 제목 키워드 기반
Linearized Physics-Based Lithium-Ion Battery Model for Power System Economic Studies
This paper proposes the linearized physics-based model of a lithium-ion battery that can be incorporated into the optimization framework for power system economic studies. The proposed model is a linear approximation of …
Embedding Lithium-ion Battery Scrapping Criterion and Degradation Model in Optimal Operation of Peak-shaving Energy Storage
Lithium-ion battery systems have been used in practical power systems for peak-shaving, demand response, and frequency regulation. However, a lithium-ion battery is degrading while cycling and would be scrapped when the …
Potential utilization of Battery Energy Storage Systems (BESS) in the major European electricity markets
Given the declining cost of battery technology in the last decade, nowadays BESS becomes a more attractive solution in electrical power systems. The objective of this work is to analyze the potential utilization of BESS …
Peak Forecasting for Battery-based Energy Optimizations in Campus Microgrids
Battery-based energy storage has emerged as an enabling technology for a variety of grid energy optimizations, such as peak shaving and cost arbitrage. A key component of battery-driven peak shaving optimizations is peak…
Load ForecastingEvaluating the Impact of Model Accuracy for Optimizing Battery Energy Storage Systems
This study investigates two models of varying complexity for optimizing intraday arbitrage energy trading of a battery energy storage system using a model predictive control approach. Scenarios reflecting different stage…
energy tradingModel Predictive Control