Multi-agent reinforcement learning for wall modeling in LES of flow over periodic hills

2022-11-29 · Di Zhou, Michael P. Whitmore, Kevin P. Griffin, H. Jane Bae

We develop a wall model for large-eddy simulation (LES) that takes into account various pressure-gradient effects using multi-agent reinforcement learning (MARL). The model is trained using low-Reynolds-number flow over periodic hills with agents distributed on the wall along the computational grid points. The model utilizes a wall eddy-viscosity formulation as the boundary condition, which is shown to provide better predictions of the mean velocity field, rather than the typical wall-shear stress formulation. Each agent receives states based on local instantaneous flow quantities at an off-wall location, computes a reward based on the estimated wall-shear stress, and provides an action to update the wall eddy viscosity at each time step. The trained wall model is validated in wall-modeled LES (WMLES) of flow over periodic hills at higher Reynolds numbers, and the results show the effectiveness of the model on flow with pressure gradients. The analysis of the trained model indicates that the model is capable of distinguishing between the various pressure gradient regimes present in the flow.

📄 PDF Abstract BibTeX arXiv:2211.16427

Code (0)

등록된 구현이 없습니다.

Tasks

Multi-agent Reinforcement Learning

Scientific multi-agent reinforcement learning for wall-models of turbulent flows

2021-06-21 · H. Jane Bae, Petros Koumoutsakos

The predictive capabilities of turbulent flow simulations, critical for aerodynamic design and weather prediction, hinge on the choice of turbulence models. The abundance of data from experiments and simulations and the …

Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning (RL)

Gradient-free learning of a closed-loop wall controller for turbulent drag reduction

2026-07-14 · Giorgio Maria Cavallazzi, Miguel Pérez Cuadrado, Alfredo Pinelli arxiv

Closed-loop wall controllers learnt by multi-agent reinforcement learning are usually trained on periodic boxes far smaller than the flows they are meant to drive, and a large part of their drag reduction is lost when th…

Multi-agent Reinforcement Learning

CoSkill: Joint Reinforcement Learning of Reasoning and Meta-Skill Agents for Hierarchical Skill Evolution

2026-09-04 · Jinyuan Feng, Dongmin Li, Yiqun Chen, Yang Gao 외 arxiv

Skill libraries improve the sample efficiency of agentic reinforcement learning (RL) by enabling large language model (LLM) agents to reuse procedural knowledge. Yet existing paradigms exhibit structural shortcomings: th…

Reinforcement Learning

Explainable deep reinforcement learning reveals energy-efficient control strategies for turbulent drag reduction

2026-05-31 · Federica Tonti, Ricardo Vinuesa arxiv

We propose a method combining Multi-Agent Deep Reinforcement Learning (MARL) and eXplainable Deep Learning (XDL) to reduce drag in wall-bounded turbulent flows. Taking as a baseline the results of training agents directl…

Reinforcement Learning

Turbulence control in plane Couette flow using low-dimensional neural ODE-based models and deep reinforcement learning

2023-01-28 · Alec J. Linot, Kevin Zeng, Michael D. Graham

The high dimensionality and complex dynamics of turbulent flows remain an obstacle to the discovery and implementation of control strategies. Deep reinforcement learning (RL) is a promising avenue for overcoming these ob…

Deep Reinforcement Learning Reinforcement Learning (RL)