Reinforcement learning with learned gadgets to tackle hard quantum problems on real hardware

2024-10-31 · Akash Kundu, Leopoldo Sarra

Designing quantum circuits for specific tasks is challenging due to the exponential growth of the state space. We introduce gadget reinforcement learning (GRL), which integrates reinforcement learning with program synthesis to automatically generate and incorporate composite gates (gadgets) into the action space. This enhances the exploration of parameterized quantum circuits (PQCs) for complex tasks like approximating ground states of quantum Hamiltonians, an NP-hard problem. We evaluate GRL using the transverse field Ising model under typical computational budgets (e.g., 2- 3 days of GPU runtime). Our results show improved accuracy, hardware compatibility and scalability. GRL exhibits robust performance as the size and complexity of the problem increases, even with constrained computational resources. By integrating gadget extraction, GRL facilitates the discovery of reusable circuit components tailored for specific hardware, bridging the gap between algorithmic design and practical implementation. This makes GRL a versatile framework for optimizing quantum circuits with applications in hardware-specific optimizations and variational quantum algorithms. The code is available at: https://github.com/Aqasch/Gadget_RL

📄 PDF Abstract BibTeX arXiv:2411.00230

Code (1)

aqasch/gadget_rl 공식 구현 pytorch

Tasks

GPUProgram Synthesis reinforcement-learning Reinforcement Learning

Methods 이 논문이 사용한 방법론

Focus 설명 없음

Automated Gadget Discovery in Science

2022-12-24 · Lea M. Trenkwalder, Andrea López Incera, Hendrik Poulsen Nautrup, Fulvio Flamini 외

In recent years, reinforcement learning (RL) has become increasingly successful in its application to science and the process of scientific discovery in general. However, while RL algorithms learn to solve increasingly c…

Clustering Reinforcement Learning (RL)scientific discovery

Quantum Circuit Optimization with AlphaTensor

2024-02-22 · Francisco J. R. Ruiz, Tuomas Laakkonen, Johannes Bausch, Matej Balog 외

A key challenge in realizing fault-tolerant quantum computers is circuit optimization. Focusing on the most expensive gates in fault-tolerant quantum computation (namely, the T gates), we address the problem of T-count o…

Deep Reinforcement Learning Tensor Decomposition

From Classical Data to Quantum Advantage -- Quantum Policy Evaluation on Quantum Hardware

2025-09-09 · Daniel Hein, Simon Wiedemann, Markus Baumann, Patrik Felbinger 외 arxiv

Quantum policy evaluation (QPE) is a reinforcement learning (RL) algorithm which is quadratically more efficient than an analogous classical Monte Carlo estimation. It makes use of a direct quantum mechanical realization…

Quantum Machine Learning Reinforcement Learning

Enhancing variational quantum state diagonalization using reinforcement learning techniques

2023-06-19 · Akash Kundu, Przemysław Bedełek, Mateusz Ostaszewski, Onur Danaci 외

The variational quantum algorithms are crucial for the application of NISQ computers. Such algorithms require short quantum circuits, which are more amenable to implementation on near-term hardware, and many such methods…

Quantum Machine Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Learning Logical Operations for Arbitrary Quantum Error Correction Codes

2026-05-27 · Nico Meyer, Christopher Mutschler, Dominik Seuß, Andreas Maier 외 arxiv

Logical operations are essential for quantum computation within quantum error-correcting codes. However, discovering their physical realizations is challenging, especially for non-additive codes that lack a stabilizer de…