Quantum policy gradient algorithms

2022-12-19 · Sofiene Jerbi, Arjan Cornelissen, Māris Ozols, Vedran Dunjko

Understanding the power and limitations of quantum access to data in machine learning tasks is primordial to assess the potential of quantum computing in artificial intelligence. Previous works have already shown that speed-ups in learning are possible when given quantum access to reinforcement learning environments. Yet, the applicability of quantum algorithms in this setting remains very limited, notably in environments with large state and action spaces. In this work, we design quantum algorithms to train state-of-the-art reinforcement learning policies by exploiting quantum interactions with an environment. However, these algorithms only offer full quadratic speed-ups in sample complexity over their classical analogs when the trained policies satisfy some regularity conditions. Interestingly, we find that reinforcement learning policies derived from parametrized quantum circuits are well-behaved with respect to these conditions, which showcases the benefit of a fully-quantum reinforcement learning framework.

📄 PDF Abstract BibTeX arXiv:2212.09328

Code (0)

등록된 구현이 없습니다.

Tasks

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Quantum Policy Gradient in Reproducing Kernel Hilbert Space

2024-11-11 · David M. Bossens, Kishor Bharti, Jayne Thompson

Parametrised quantum circuits offer expressive and data-efficient representations for machine learning. Due to quantum states residing in a high-dimensional Hilbert space, parametrised quantum circuits have a natural int…

Policy Gradient based Quantum Approximate Optimization Algorithm

2020-02-04 · Jiahao Yao, Marin Bukov, Lin Lin

The quantum approximate optimization algorithm (QAOA), as a hybrid quantum/classical algorithm, has received much interest recently. QAOA can also be viewed as a variational ansatz for quantum control. However, its direc…

Reinforcement Learning Reinforcement Learning (RL)

Accelerating Quantum Reinforcement Learning with a Quantum Natural Policy Gradient Based Approach

2025-01-27 · Yang Xu, Vaneet Aggarwal

We address the problem of quantum reinforcement learning (QRL) under model-free settings with quantum oracle access to the Markov Decision Process (MDP). This paper introduces a Quantum Natural Policy Gradient (QNPG) alg…

Policy Gradients using Variational Quantum Circuits

2022-03-20 · André Sequeira, Luis Paulo Santos, Luís Soares Barbosa

Variational Quantum Circuits are being used as versatile Quantum Machine Learning models. Some empirical results exhibit an advantage in supervised and generative learning tasks. However, when applied to Reinforcement Le…

Benchmarking Quantum Machine Learning reinforcement-learning Reinforcement Learning+1

Breaking Through Barren Plateaus: Reinforcement Learning Initializations for Deep Variational Quantum Circuits

2025-08-25 · Yifeng Peng, Xinyi Li, Zhemin Zhang, Samuel Yen-Chi Chen 외 arxiv

Variational Quantum Algorithms (VQAs) have gained prominence as a viable framework for exploiting near-term quantum devices in applications ranging from optimization and chemistry simulation to machine learning. However,…

Reinforcement Learning