Deep Reinforcement Learning for Optimizing Inverter Control: Fixed and Adaptive Gain Tuning Strategies for Power System Stability
This paper presents novel methods for tuning inverter controller gains using deep reinforcement learning (DRL). A Simulink-developed inverter model is converted into a dynamic link library (DLL) and integrated with a Python-based RL environment, leveraging the multi-core deployment and accelerated computing to significantly reduce RL training time. A neural network-based mechanism is developed to transform the cascaded PI controller into an actor network, allowing optimized gain tuning by an RL agent to mitigate scenarios such as subsynchronous oscillations (SSO) and initial transients. Two distinct tuning approaches are demonstrated: a fixed gain strategy, where controller gains are represented as RL policy (actor network) weights, and an adaptive gain strategy, where gains are dynamically generated as RL policy (actor network) outputs. A comparative analysis of these methods is provided, showcasing their effectiveness in stabilizing the transient performance of grid-forming and grid-following converters and deployment challenges in hardware. Experimental results are presented, demonstrating the enhanced robustness and practical applicability of the RL-tuned controller gains in real-world systems.
Code (0)
등록된 구현이 없습니다.
Tasks
Deep Reinforcement LearningMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Neuro-Inspired Inverse Learning for Planning and Control
We present a neuro-inspired framework for embodied planning and control. Building on three principles that enable fast and highly effective goal-directed behavior in the mammalian brain - paired forward/inverse internal …
Reinforcement LearningControl Designs for Critical-Continegency Responsible Grid-Following Inverters and Seamless Transitions To and From Grid-Forming Modes
This article introduces two control frameworks: one for Grid-Following (GFL) inverters aiding Grid-Forming (GFM) inverters in voltage regulation during large contingency events and optimizing power transactions under nor…
An Improved Decentralized Control of Grid-Connected Cascaded Inverters with Different Power Capacities
The existing decentralized control for cascaded inverters is based on the assumption that all modules have same capacities, and a local fixed-amplitude-varied-phase voltage control is adopted for each inverter module. Ho…
Reinforcement Learning$\unicode{x2013}$Based Transient Response Shaping for Microgrids
This work explores the usage of a supplementary controller for improving the transient performance of inverter$\unicode{x2013}$based resources (IBR) in microgrids. The supplementary controller is trained using a reinforc…
reinforcement-learningReinforcement LearningReinforcement Learning (RL)Deep Reinforcement Learning for Adaptive Traffic Signal Control
Many existing traffic signal controllers are either simple adaptive controllers based on sensors placed around traffic intersections, or optimized by traffic engineers on a fixed schedule. Optimizing traffic controllers …
Deep Reinforcement Learningreinforcement-learningReinforcement LearningReinforcement Learning (RL)+1