paper-with-me

홈 › Papers

Climate Surrogates for Scalable Multi-Agent Reinforcement Learning: A Case Study with CICERO-SCM

2025-10-09 · Oskar Bohn Lassen, Serio Angelo Maria Agriesti, Filipe Rodrigues, Francisco Camara Pereira arxiv

Climate policy studies require models that capture the combined effects of multiple greenhouse gases on global temperature, but these models are computationally expensive and difficult to embed in reinforcement learning. We present a multi-agent reinforcement learning (MARL) framework that integrates a high-fidelity, highly efficient climate surrogate directly in the environment loop, enabling regional agents to learn climate policies under multi-gas dynamics. As a proof of concept, we introduce a recurrent neural network architecture pretrained on ($20{,}000$) multi-gas emission pathways to surrogate the climate model CICERO-SCM. The surrogate model attains near-simulator accuracy with global-mean temperature RMSE $\approx 0.0004 \mathrm{K}$ and approximately $1000\times$ faster one-step inference. When substituted for the original simulator in a climate-policy MARL setting, it accelerates end-to-end training by $>\!100\times$. We show that the surrogate and simulator converge to the same optimal policies and propose a methodology to assess this property in cases where using the simulator is intractable. Our work allows to bypass the core computational bottleneck without sacrificing policy fidelity, enabling large-scale multi-agent experiments across alternative climate-policy regimes with multi-gas dynamics and high-fidelity climate response.

📄 PDF Abstract BibTeX arXiv:2510.07971

Code (0)

등록된 구현이 없습니다.

Tasks

Multi-agent Reinforcement Learning

Similar Papers 제목 키워드 기반

FedRAIN-Lite: Federated Reinforcement Algorithms for Improving Idealised Numerical Weather and Climate Models

2025-08-19 · Pritthijit Nath, Sebastian Schemm, Henry Moss, Peter Haynes 외 arxiv

Sub-grid parameterisations in climate models are traditionally static and tuned offline, limiting adaptability to evolving states. This work introduces FedRAIN-Lite, a federated reinforcement learning (FedRL) framework t…

Reinforcement Learning

InvestESG: A multi-agent reinforcement learning benchmark for studying climate investment as a social dilemma

2024-11-15 · Xiaoxuan Hou, Jiayi Yuan, Joel Z. Leibo, Natasha Jaques

InvestESG is a novel multi-agent reinforcement learning (MARL) benchmark designed to study the impact of Environmental, Social, and Governance (ESG) disclosure mandates on corporate climate investments. The benchmark mod…

Multi-agent Reinforcement Learning

Centralised rehearsal of decentralised cooperation: Multi-agent reinforcement learning for the scalable coordination of residential energy flexibility

2023-05-30 · Flora Charbonnier, Bei Peng, Thomas Morstyn, Malcolm McCulloch

This paper investigates how deep multi-agent reinforcement learning can enable the scalable and privacy-preserving coordination of residential energy flexibility. The coordination of distributed resources such as electri…

Multi-agent Reinforcement LearningPrivacy Preservingreinforcement-learningReinforcement Learning

Replacing Tunable Parameters in Weather and Climate Models with State-Dependent Functions using Reinforcement Learning

2026-01-07 · Pritthijit Nath, Sebastian Schemm, Henry Moss, Peter Haynes 외 arxiv

Weather and climate models rely on parametrisations to represent unresolved sub-grid processes. Traditional schemes rely on fixed coefficients that are weakly constrained and tuned offline, contributing to persistent bia…

Reinforcement Learning

Multi-Agent Reinforcement Learning Simulation for Environmental Policy Synthesis

2025-04-17 · James Rudd-Jones, Mirco Musolesi, María Pérez-Ortiz

Climate policy development faces significant challenges due to deep uncertainty, complex system dynamics, and competing stakeholder interests. Climate simulation methods, such as Earth System Models, have become valuable…

Multi-agent Reinforcement Learningreinforcement-learningReinforcement LearningUncertainty Quantification