Accelerating Quantum Reinforcement Learning with a Quantum Natural Policy Gradient Based Approach

2025-01-27 · Yang Xu, Vaneet Aggarwal

We address the problem of quantum reinforcement learning (QRL) under model-free settings with quantum oracle access to the Markov Decision Process (MDP). This paper introduces a Quantum Natural Policy Gradient (QNPG) algorithm, which replaces the random sampling used in classical Natural Policy Gradient (NPG) estimators with a deterministic gradient estimation approach, enabling seamless integration into quantum systems. While this modification introduces a bounded bias in the estimator, the bias decays exponentially with increasing truncation levels. This paper demonstrates that the proposed QNPG algorithm achieves a sample complexity of $\tilde{\mathcal{O}}(\epsilon^{-1.5})$ for queries to the quantum oracle, significantly improving the classical lower bound of $\tilde{\mathcal{O}}(\epsilon^{-2})$ for queries to the MDP.

📄 PDF Abstract BibTeX arXiv:2501.16243

Code (0)

등록된 구현이 없습니다.

Quantum Fisher-Preconditioned Reinforcement Learning: From Single-Qubit Control to Rayleigh-Fading Link Adaptation

2025-06-18 · Oluwaseyi Giwa, Muhammad Ahmed Mohsin, Muhammad Ali Jamshed

In this letter, we propose Quantum-Preconditioned Policy Gradient (QPPG), a natural gradient-based algorithm for link adaptation that whitens policy updates using the full inverse quantum Fisher information with Tikhonov…

Quantum Reinforcement Learning via Policy Iteration

2022-03-03 · El Amine Cherrat, Iordanis Kerenidis, Anupam Prakash

Quantum computing has shown the potential to substantially speed up machine learning applications, in particular for supervised and unsupervised learning. Reinforcement learning, on the other hand, has become essential f…

Decision Making reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Quantum Natural Policy Gradients: Towards Sample-Efficient Reinforcement Learning

2023-04-26 · Nico Meyer, Daniel D. Scherer, Axel Plinge, Christopher Mutschler 외

Reinforcement learning is a growing field in AI with a lot of potential. Intelligent behavior is learned automatically through trial and error in interaction with the environment. However, this learning process is often …

Multi-Armed Bandits reinforcement-learning Reinforcement Learning

Model-free Quantum Gate Design and Calibration using Deep Reinforcement Learning

2023-02-05 · Omar Shindi, Qi Yu, Parth Girdhar, Daoyi Dong

High-fidelity quantum gate design is important for various quantum technologies, such as quantum computation and quantum communication. Numerous control policies for quantum gate design have been proposed given a dynamic…

Deep Reinforcement Learning Model free quantum gate design quantum gate calibration quantum gate design+3

Quantum Policy Iteration via Amplitude Estimation and Grover Search -- Towards Quantum Advantage for Reinforcement Learning

2022-06-09 · Simon Wiedemann, Daniel Hein, Steffen Udluft, Christian Mendl

We present a full implementation and simulation of a novel quantum reinforcement learning method. Our work is a detailed and formal proof of concept for how quantum algorithms can be used to solve reinforcement learning …

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)