paper-with-me

Papers

Optimal Planning of Hybrid Energy Storage Systems using Curtailed Renewable Energy through Deep Reinforcement Learning

2022-12-12 · Dongju Kang, Doeun Kang, Sumin Hwangbo, Haider Niaz, Won Bo Lee, J. Jay Liu, Jonggeol Na

Energy management systems (EMS) are becoming increasingly important in order to utilize the continuously growing curtailed renewable energy. Promising energy storage systems (ESS), such as batteries and green hydrogen should be employed to maximize the efficiency of energy stakeholders. However, optimal decision-making, i.e., planning the leveraging between different strategies, is confronted with the complexity and uncertainties of large-scale problems. Here, we propose a sophisticated deep reinforcement learning (DRL) methodology with a policy-based algorithm to realize the real-time optimal ESS planning under the curtailed renewable energy uncertainty. A quantitative performance comparison proved that the DRL agent outperforms the scenario-based stochastic optimization (SO) algorithm, even with a wide action and observation space. Owing to the uncertainty rejection capability of the DRL, we could confirm a robust performance, under a large uncertainty of the curtailed renewable energy, with a maximizing net profit and stable system. Action-mapping was performed for visually assessing the action taken by the DRL agent according to the state. The corresponding results confirmed that the DRL agent learns the way like what a human expert would do, suggesting reliable application of the proposed methodology.

📄 PDF Abstract BibTeX arXiv:2212.05662

Code (1)

kangdj6358/emsrl 공식 구현 pytorch

Tasks

Decision MakingDeep Reinforcement Learningenergy managementManagementStochastic Optimization

Similar Papers 제목 키워드 기반

Capturing Chronology and Extreme Values of Representative Days for Planning of Transmission Lines and Long-Term Energy Storage Systems

2023-10-06 · Mojtaba Moradi-Sepahvand, Simon H. Tindemans

The growing penetration of renewable energy sources (RESs) is inevitable to reach net zero emissions. In this regard, optimal planning and operation of power systems are becoming more critical due to the need for modelin…

Time Series

Joint Planning of Distributed Generations and Energy Storage in Active Distribution Networks: A Bi-Level Programming Approach

2022-01-15 · Yang Li, Bo Feng, Bin Wang, Shuchao Sun

In order to improve the penetration of renewable energy resources for distribution networks, a joint planning model of distributed generations (DGs) and energy storage is proposed for an active distribution network by us…

Optimal Co-Design of a Hybrid Energy Storage System for Truck Charging

2025-06-02 · Juan Pablo Bertucci, Sudarshan Raghuraman, Mauro Salazar, Theo Hofman

The major challenges to battery electric truck adoption are their high cost and grid congestion.In this context, stationary energy storage systems can help mitigate both issues. Since their design and operation are stron…

Collaborative planning of integrated hydrogen energy chain multi-energy systems: A review

2024-05-16 · Xinning Yia, Tianguang Lua, Jing Li, Shaocong Wu

Most planning of the traditional hydrogen energy supply chain (HSC) focuses on the storage and transportation links between production and consumption ends. It ignores the energy flows and interactions between each link,…

Articles

Enhancing Building Energy Efficiency through Advanced Sizing and Dispatch Methods for Energy Storage

2023-10-19 · Min Gyung Yu, Xu Ma, Bowen Huang, Karthik Devaprasad 외

Energy storage and electrification of buildings hold great potential for future decarbonized energy systems. However, there are several technical and economic barriers that prevent large-scale adoption and integration of…

Decision Making