Reinforcement Learning with Quantum Variational Circuits

2020-08-15 · Owen Lockwood, Mei Si

The development of quantum computational techniques has advanced greatly in recent years, parallel to the advancements in techniques for deep reinforcement learning. This work explores the potential for quantum computing to facilitate reinforcement learning problems. Quantum computing approaches offer important potential improvements in time and space complexity over traditional algorithms because of its ability to exploit the quantum phenomena of superposition and entanglement. Specifically, we investigate the use of quantum variational circuits, a form of quantum machine learning. We present our techniques for encoding classical data for a quantum variational circuit, we further explore pure and hybrid quantum algorithms for DQN and Double DQN. Our results indicate both hybrid and pure quantum variational circuit have the ability to solve reinforcement learning tasks with a smaller parameter space. These comparison are conducted with two OpenAI Gym environments: CartPole and Blackjack, The success of this work is indicative of a strong future relationship between quantum machine learning and deep reinforcement learning.

📄 PDF Abstract BibTeX arXiv:2008.07524

Code (2)

luthierman/quantum-research tf

luthierman/quantum-research-colab pytorch

Tasks

BIG-bench Machine LearningDeep Reinforcement LearningOpenAI Gym Quantum Machine Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Methods 이 논문이 사용한 방법론

Q-Learning Q-Learning is an off-policy temporal difference control algorithm: $$Q\left(S\_{t}, A\_{t}\right) \leftarrow Q\left(S\_{t}, A\_{t}\right) + \alpha\left[R_{t+1} +…

Experience Replay Experience Replay is a replay memory technique used in reinforcement learning where we store the agent’s experiences at each time-step, $e\_{t} = \left(s\_{t}, a\_{t}, r\_{t},…

Double Q-learning Double Q-learning is an off-policy reinforcement learning algorithm that utilises double estimation to counteract overestimation problems with traditional Q-learning. The…

Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…

Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…

Double DQN 설명 없음

DQN A DQN, or Deep Q-Network, approximates a state-value function in a Q-Learning framework with a neural network. In the Atari…

Variational Quantum Circuits for Deep Reinforcement Learning

2019-06-30 · Samuel Yen-Chi Chen, Chao-Han Huck Yang, Jun Qi, Pin-Yu Chen 외

The state-of-the-art machine learning approaches are based on classical von Neumann computing architectures and have been widely used in many industrial and academic domains. With the recent development of quantum comput…

BIG-bench Machine Learning Decision Making Deep Reinforcement Learning Quantum Machine Learning+3

Enhancing variational quantum state diagonalization using reinforcement learning techniques

2023-06-19 · Akash Kundu, Przemysław Bedełek, Mateusz Ostaszewski, Onur Danaci 외

The variational quantum algorithms are crucial for the application of NISQ computers. Such algorithms require short quantum circuits, which are more amenable to implementation on near-term hardware, and many such methods…

Quantum Machine Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Reinforcement learning-assisted quantum architecture search for variational quantum algorithms

2024-02-21 · Akash Kundu

A significant hurdle in the noisy intermediate-scale quantum (NISQ) era is identifying functional quantum circuits. These circuits must also adhere to the constraints imposed by current quantum hardware limitations. Vari…

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Optimizing Quantum Variational Circuits with Deep Reinforcement Learning

2021-09-07 · Owen Lockwood

Quantum Machine Learning (QML) is considered to be one of the most promising applications of near term quantum devices. However, the optimization of quantum machine learning models presents numerous challenges arising fr…

BIG-bench Machine Learning Deep Reinforcement Learning Quantum Machine Learning reinforcement-learning+2

Policy Gradients using Variational Quantum Circuits

2022-03-20 · André Sequeira, Luis Paulo Santos, Luís Soares Barbosa

Variational Quantum Circuits are being used as versatile Quantum Machine Learning models. Some empirical results exhibit an advantage in supervised and generative learning tasks. However, when applied to Reinforcement Le…

Benchmarking Quantum Machine Learning reinforcement-learning Reinforcement Learning+1