paper-with-me

홈 › Papers

Data-driven battery operation for energy arbitrage using rainbow deep reinforcement learning

2021-06-10 · Daniel J. B. Harrold, Jun Cao, Zhong Fan

As the world seeks to become more sustainable, intelligent solutions are needed to increase the penetration of renewable energy. In this paper, the model-free deep reinforcement learning algorithm Rainbow Deep Q-Networks is used to control a battery in a small microgrid to perform energy arbitrage and more efficiently utilise solar and wind energy sources. The grid operates with its own demand and renewable generation based on a dataset collected at Keele University, as well as using dynamic energy pricing from a real wholesale energy market. Four scenarios are tested including using demand and price forecasting produced with local weather data. The algorithm and its subcomponents are evaluated against two continuous control benchmarks with Rainbow able to outperform all other method. This research shows the importance of using the distributional approach for reinforcement learning when working with complex environments and reward functions, as well as how it can be used to visualise and contextualise the agent's behaviour for real-world applications.

📄 PDF Abstract BibTeX arXiv:2106.06061

Code (0)

등록된 구현이 없습니다.

Tasks

continuous-controlContinuous ControlDeep Reinforcement Learningreinforcement-learningReinforcement LearningReinforcement Learning (RL)

Similar Papers 제목 키워드 기반

Linearized Physics-Based Lithium-Ion Battery Model for Power System Economic Studies

2022-07-07 · Anton V. Vykhodtsev, Darren Jang, Qianpu Wang, William Rosehart 외

This paper proposes the linearized physics-based model of a lithium-ion battery that can be incorporated into the optimization framework for power system economic studies. The proposed model is a linear approximation of …

Embedding Lithium-ion Battery Scrapping Criterion and Degradation Model in Optimal Operation of Peak-shaving Energy Storage

2019-10-04 · Qingchun Hou, Yanghao Yu, Ershun Du, Hongjie He 외

Lithium-ion battery systems have been used in practical power systems for peak-shaving, demand response, and frequency regulation. However, a lithium-ion battery is degrading while cycling and would be scrapped when the …

Potential utilization of Battery Energy Storage Systems (BESS) in the major European electricity markets

2021-12-18 · Yu Hu, Miguel Armada, Maria Jesus Sanchez

Given the declining cost of battery technology in the last decade, nowadays BESS becomes a more attractive solution in electrical power systems. The objective of this work is to analyze the potential utilization of BESS …

Peak Forecasting for Battery-based Energy Optimizations in Campus Microgrids

2020-05-25 · Akhil Soman, Amee Trivedi, David Irwin, Beka Kosanovic 외

Battery-based energy storage has emerged as an enabling technology for a variety of grid energy optimizations, such as peak shaving and cost arbitrage. A key component of battery-driven peak shaving optimizations is peak…

Load Forecasting

Evaluating the Impact of Model Accuracy for Optimizing Battery Energy Storage Systems

2025-06-20 · Martin Cornejo, Melina Graner, Holger Hesse, Andreas Jossen

This study investigates two models of varying complexity for optimizing intraday arbitrage energy trading of a battery energy storage system using a model predictive control approach. Scenarios reflecting different stage…

energy tradingModel Predictive Control