Optimal Planning of Hybrid Energy Storage Systems using Curtailed Renewable Energy through Deep Reinforcement Learning
Energy management systems (EMS) are becoming increasingly important in order to utilize the continuously growing curtailed renewable energy. Promising energy storage systems (ESS), such as batteries and green hydrogen should be employed to maximize the efficiency of energy stakeholders. However, optimal decision-making, i.e., planning the leveraging between different strategies, is confronted with the complexity and uncertainties of large-scale problems. Here, we propose a sophisticated deep reinforcement learning (DRL) methodology with a policy-based algorithm to realize the real-time optimal ESS planning under the curtailed renewable energy uncertainty. A quantitative performance comparison proved that the DRL agent outperforms the scenario-based stochastic optimization (SO) algorithm, even with a wide action and observation space. Owing to the uncertainty rejection capability of the DRL, we could confirm a robust performance, under a large uncertainty of the curtailed renewable energy, with a maximizing net profit and stable system. Action-mapping was performed for visually assessing the action taken by the DRL agent according to the state. The corresponding results confirmed that the DRL agent learns the way like what a human expert would do, suggesting reliable application of the proposed methodology.
Code (1)
Tasks
Decision MakingDeep Reinforcement Learningenergy managementManagementStochastic OptimizationSimilar Papers 제목 키워드 기반
Capturing Chronology and Extreme Values of Representative Days for Planning of Transmission Lines and Long-Term Energy Storage Systems
The growing penetration of renewable energy sources (RESs) is inevitable to reach net zero emissions. In this regard, optimal planning and operation of power systems are becoming more critical due to the need for modelin…
Time SeriesJoint Planning of Distributed Generations and Energy Storage in Active Distribution Networks: A Bi-Level Programming Approach
In order to improve the penetration of renewable energy resources for distribution networks, a joint planning model of distributed generations (DGs) and energy storage is proposed for an active distribution network by us…
Optimal Co-Design of a Hybrid Energy Storage System for Truck Charging
The major challenges to battery electric truck adoption are their high cost and grid congestion.In this context, stationary energy storage systems can help mitigate both issues. Since their design and operation are stron…
Collaborative planning of integrated hydrogen energy chain multi-energy systems: A review
Most planning of the traditional hydrogen energy supply chain (HSC) focuses on the storage and transportation links between production and consumption ends. It ignores the energy flows and interactions between each link,…
ArticlesEnhancing Building Energy Efficiency through Advanced Sizing and Dispatch Methods for Energy Storage
Energy storage and electrification of buildings hold great potential for future decarbonized energy systems. However, there are several technical and economic barriers that prevent large-scale adoption and integration of…
Decision Making