WFCRL: A Multi-Agent Reinforcement Learning Benchmark for Wind Farm Control

2025-01-23 · Claire Bizon Monroc, Ana Bušić, Donatien Dubuc, Jiamin Zhu

The wind farm control problem is challenging, since conventional model-based control strategies require tractable models of complex aerodynamical interactions between the turbines and suffer from the curse of dimension when the number of turbines increases. Recently, model-free and multi-agent reinforcement learning approaches have been used to address this challenge. In this article, we introduce WFCRL (Wind Farm Control with Reinforcement Learning), the first open suite of multi-agent reinforcement learning environments for the wind farm control problem. WFCRL frames a cooperative Multi-Agent Reinforcement Learning (MARL) problem: each turbine is an agent and can learn to adjust its yaw, pitch or torque to maximize the common objective (e.g. the total power production of the farm). WFCRL also offers turbine load observations that will allow to optimize the farm performance while limiting turbine structural damages. Interfaces with two state-of-the-art farm simulators are implemented in WFCRL: a static simulator (FLORIS) and a dynamic simulator (FAST.Farm). For each simulator, $10$ wind layouts are provided, including $5$ real wind farms. Two state-of-the-art online MARL algorithms are implemented to illustrate the scaling challenges. As learning online on FAST.Farm is highly time-consuming, WFCRL offers the possibility of designing transfer learning strategies from FLORIS to FAST.Farm.

📄 PDF Abstract BibTeX arXiv:2501.13592

Code (1)

ifpen/wfcrl-env 공식 구현

Tasks

Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning Transfer Learning

Deep Reinforcement Learning for Multi-Objective Optimization: Enhancing Wind Turbine Energy Generation while Mitigating Noise Emissions

2024-07-18 · Martín de Frutos, Oscar A. Marino, David Huergo, Esteban Ferrer

We develop a torque-pitch control framework using deep reinforcement learning for wind turbines to optimize the generation of wind turbine energy while minimizing operational noise. We employ a double deep Q-learning, co…

Deep Reinforcement Learning Pitch control Q-Learning reinforcement-learning+1

Windows Agent Arena: Evaluating Multi-Modal OS Agents at Scale

2024-09-12 · Rogerio Bonatti, Dan Zhao, Francesco Bonacci, Dillon Dupont 외

Large language models (LLMs) show remarkable potential to act as computer agents, enhancing human productivity and software accessibility in multi-modal tasks that require planning and reasoning. However, measuring agent…

Load constrained wind farm flow control through multi-objective multi-agent reinforcement learning

2026-04-13 · Teodor Åstrand, Marcus Binder Nilsen, Iasonas Tsaklis, Tuhfe Göçmen 외 arxiv

This study presents a multi-agent reinforcement learning (MARL) framework for load-constrained wind farm flow control (WFFC). While wake steering can enhance total wind farm power, it often introduces increased structura…

Multi-agent Reinforcement Learning

Reinforcement learning to maximise wind turbine energy generation

2024-02-17 · Daniel Soler, Oscar Mariño, David Huergo, Martín de Frutos 외

We propose a reinforcement learning strategy to control wind turbine energy generation by actively changing the rotor speed, the rotor yaw angle and the blade pitch angle. A double deep Q-learning with a prioritized expe…

Q-Learning reinforcement-learning Reinforcement Learning

Beyond Turn Limits: Training Deep Search Agents with Dynamic Context Window

2025-10-09 · Qiaoyu Tang, Hao Xiang, Le Yu, Bowen Yu 외 arxiv

While recent advances in reasoning models have demonstrated cognitive behaviors through reinforcement learning, existing approaches struggle to invoke deep reasoning capabilities in multi-turn agents with long-horizon in…

Reinforcement Learning