paper-with-me

Papers

Deep Reinforcement Learning for Optimizing Inverter Control: Fixed and Adaptive Gain Tuning Strategies for Power System Stability

2024-11-03 · Shuvangkar Chandra Das, Tuyen Vu, Deepak Ramasubramanian, Evangelos Farantatos, Jianhua Zhang, Thomas Ortmeyer

This paper presents novel methods for tuning inverter controller gains using deep reinforcement learning (DRL). A Simulink-developed inverter model is converted into a dynamic link library (DLL) and integrated with a Python-based RL environment, leveraging the multi-core deployment and accelerated computing to significantly reduce RL training time. A neural network-based mechanism is developed to transform the cascaded PI controller into an actor network, allowing optimized gain tuning by an RL agent to mitigate scenarios such as subsynchronous oscillations (SSO) and initial transients. Two distinct tuning approaches are demonstrated: a fixed gain strategy, where controller gains are represented as RL policy (actor network) weights, and an adaptive gain strategy, where gains are dynamically generated as RL policy (actor network) outputs. A comparative analysis of these methods is provided, showcasing their effectiveness in stabilizing the transient performance of grid-forming and grid-following converters and deployment challenges in hardware. Experimental results are presented, demonstrating the enhanced robustness and practical applicability of the RL-tuned controller gains in real-world systems.

📄 PDF Abstract BibTeX arXiv:2411.01451

Code (0)

등록된 구현이 없습니다.

Tasks

Deep Reinforcement Learning

Methods 이 논문이 사용한 방법론

Library 설명 없음

Similar Papers 제목 키워드 기반

Neuro-Inspired Inverse Learning for Planning and Control

2026-05-22 · Maryna Kapitonova, Tonio Ball arxiv

We present a neuro-inspired framework for embodied planning and control. Building on three principles that enable fast and highly effective goal-directed behavior in the mammalian brain - paired forward/inverse internal …

Reinforcement Learning

Control Designs for Critical-Continegency Responsible Grid-Following Inverters and Seamless Transitions To and From Grid-Forming Modes

2024-03-22 · Jaesang Park, Alireza Askarian, Srinivasa Salapaka

This article introduces two control frameworks: one for Grid-Following (GFL) inverters aiding Grid-Forming (GFM) inverters in voltage regulation during large contingency events and optimizing power transactions under nor…

An Improved Decentralized Control of Grid-Connected Cascaded Inverters with Different Power Capacities

2018-12-20

The existing decentralized control for cascaded inverters is based on the assumption that all modules have same capacities, and a local fixed-amplitude-varied-phase voltage control is adopted for each inverter module. Ho…

Reinforcement Learning$\unicode{x2013}$Based Transient Response Shaping for Microgrids

2022-07-11 · Ashwin Venkataramanan, Ali Mehrizi-Sani

This work explores the usage of a supplementary controller for improving the transient performance of inverter$\unicode{x2013}$based resources (IBR) in microgrids. The supplementary controller is trained using a reinforc…

reinforcement-learningReinforcement LearningReinforcement Learning (RL)

Deep Reinforcement Learning for Adaptive Traffic Signal Control

2019-11-14 · Kai Liang Tan, Subhadipto Poddar, Anuj Sharma, Soumik Sarkar

Many existing traffic signal controllers are either simple adaptive controllers based on sensors placed around traffic intersections, or optimized by traffic engineers on a fixed schedule. Optimizing traffic controllers …

Deep Reinforcement Learningreinforcement-learningReinforcement LearningReinforcement Learning (RL)+1