Multi-agent reinforcement learning for the control of three-dimensional Rayleigh-Bénard convection

2024-07-31 · Joel Vasanth, Jean Rabault, Francisco Alcántara-Ávila, Mikael Mortensen, Ricardo Vinuesa

Deep reinforcement learning (DRL) has found application in numerous use-cases pertaining to flow control. Multi-agent RL (MARL), a variant of DRL, has shown to be more effective than single-agent RL in controlling flows exhibiting locality and translational invariance. We present, for the first time, an implementation of MARL-based control of three-dimensional Rayleigh-B\'enard convection (RBC). Control is executed by modifying the temperature distribution along the bottom wall divided into multiple control segments, each of which acts as an independent agent. Two regimes of RBC are considered at Rayleigh numbers $\mathrm{Ra}=500$ and $750$. Evaluation of the learned control policy reveals a reduction in convection intensity by $23.5\%$ and $8.7\%$ at $\mathrm{Ra}=500$ and $750$, respectively. The MARL controller converts irregularly shaped convective patterns to regular straight rolls with lower convection that resemble flow in a relatively more stable regime. We draw comparisons with proportional control at both $\mathrm{Ra}$ and show that MARL is able to outperform the proportional controller. The learned control strategy is complex, featuring different non-linear segment-wise actuator delays and actuation magnitudes. We also perform successful evaluations on a larger domain than used for training, demonstrating that the invariant property of MARL allows direct transfer of the learnt policy.

📄 PDF Abstract BibTeX arXiv:2407.21565

Code (1)

kth-flowai/drl_marl_rayleighbenard3d_control 공식 구현

Tasks

Deep Reinforcement LearningMulti-agent Reinforcement Learning

Active flow control for three-dimensional cylinders through deep reinforcement learning

2023-09-04 · Pol Suárez, Francisco Alcántara-Ávila, Arnau Miró, Jean Rabault 외

This paper presents for the first time successful results of active flow control with multiple independently controlled zero-net-mass-flux synthetic jets. The jets are placed on a three-dimensional cylinder along its spa…

Deep Reinforcement Learning Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning+1

Optimal Path Planning and Cost Minimization for a Drone Delivery System Via Model Predictive Control

2025-03-25 · Muhammad Al-Zafar Khan, Jamal Al-Karaki

In this study, we formulate the drone delivery problem as a control problem and solve it using Model Predictive Control. Two experiments are performed: The first is on a less challenging grid world environment with lower…

Model Predictive Control Multi-agent Reinforcement Learning Navigate Q-Learning

HypeMARL: Multi-Agent Reinforcement Learning For High-Dimensional, Parametric, and Distributed Systems

2025-09-20 · Nicolò Botteghi, Matteo Tomasetto, Urban Fasel, Francesco Braghin 외 arxiv

Deep reinforcement learning has recently emerged as a promising feedback control strategy for complex dynamical systems governed by partial differential equations (PDEs). When dealing with distributed, high-dimensional p…

Multi-agent Reinforcement Learning

A Transdiagnostic Space of Disorder Like Phenotypes in Reinforcement Learning Agents

2026-07-08 · Hari Prasad arxiv

Modelling psychological disorders in artificial agents offers both a testbed for computational psychiatry and a lens on the failure modes of affective control. Prior work induces one or two disorders in a reinforcement l…

Reinforcement Learning

Toward Multi-Agent Reinforcement Learning for Distributed Event-Triggered Control

2023-05-15 · Lukas Kesper, Sebastian Trimpe, Dominik Baumann

Event-triggered communication and control provide high control performance in networked control systems without overloading the communication network. However, most approaches require precise mathematical models of the s…

Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning