Action-Factored Multi-Agent Reinforcement Learning for Scalable Quantum Device Tuning

2026-07-10 · Edwin De Nicolo, Rahul Marchand, Cornelius Carlsson, Pranav Vaidhyanathan, Natalia Ares arxiv

Cooperative multi-agent reinforcement learning is well suited to problems with large parameter spaces and exploitable local structure, such as the tuning of electrostatically-defined quantum-dot arrays. However, if parameter cross-talk is strong, a non-stationary environment from the perspective of any individual agent can destabilize learning - the same effect that plagues manual tuning of such systems. We propose using a factored representation of the action space, learned online, to decouple agents and minimize their interference. Our framework, QADAPT, uses this factorization to efficiently learn shared policies based on local measurements and rewards. With this modular strategy, we achieve zero-shot generalization to unseen quantum device sizes and maintain an approximately constant number of convergence steps to reach target regimes. This work provides a scalable route toward the rapid calibration of large-scale quantum processors.

📄 PDF Abstract BibTeX arXiv:2607.09422

Code (0)

등록된 구현이 없습니다.

Tasks

Multi-agent Reinforcement Learning Zero-shot Generalization

Safe Multi-Agent Reinforcement Learning via Shielding

2021-01-27 · Ingy Elsayed-Aly, Suda Bharadwaj, Christopher Amato, Rüdiger Ehlers 외

Multi-agent reinforcement learning (MARL) has been increasingly used in a wide range of safety-critical applications, which require guaranteed safety (e.g., no unsafe states are ever visited) during the learning process.…

Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Scalable Planning and Learning for Multiagent POMDPs: Extended Version

2014-04-04 · Christopher Amato, Frans A. Oliehoek

Online, sample-based planning algorithms for POMDPs have shown great promise in scaling to problems with large state spaces, but they become intractable for large action and observation spaces. This is particularly probl…

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Reinforcement Learning in Factored Action Spaces using Tensor Decompositions

2021-10-27 · Anuj Mahajan, Mikayel Samvelyan, Lei Mao, Viktor Makoviychuk 외

We present an extended abstract for the previously published work TESSERACT [Mahajan et al., 2021], which proposes a novel solution for Reinforcement Learning (RL) in large, factored action spaces using tensor decomposit…

Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Centralised rehearsal of decentralised cooperation: Multi-agent reinforcement learning for the scalable coordination of residential energy flexibility

2023-05-30 · Flora Charbonnier, Bei Peng, Thomas Morstyn, Malcolm McCulloch

This paper investigates how deep multi-agent reinforcement learning can enable the scalable and privacy-preserving coordination of residential energy flexibility. The coordination of distributed resources such as electri…

Multi-agent Reinforcement Learning Privacy Preserving reinforcement-learning Reinforcement Learning

FACMAC: Factored Multi-Agent Centralised Policy Gradients

2020-03-14 · NeurIPS 2021 12 · Bei Peng, Tabish Rashid, Christian A. Schroeder de Witt, Pierre-Alexandre Kamienny 외

We propose FACtored Multi-Agent Centralised policy gradients (FACMAC), a new method for cooperative multi-agent reinforcement learning in both discrete and continuous action spaces. Like MADDPG, a popular multi-agent act…

MuJoCo Multi-agent Reinforcement Learning Q-Learning Reinforcement Learning+3