Reinforcement Learning Using Quantum Boltzmann Machines
We investigate whether quantum annealers with select chip layouts can outperform classical computers in reinforcement learning tasks. We associate a transverse field Ising spin Hamiltonian with a layout of qubits similar to that of a deep Boltzmann machine (DBM) and use simulated quantum annealing (SQA) to numerically simulate quantum sampling from this system. We design a reinforcement learning algorithm in which the set of visible nodes representing the states and actions of an optimal policy are the first and last layers of the deep network. In absence of a transverse field, our simulations show that DBMs are trained more effectively than restricted Boltzmann machines (RBM) with the same number of nodes. We then develop a framework for training the network as a quantum Boltzmann machine (QBM) in the presence of a significant transverse field for reinforcement learning. This method also outperforms the reinforcement learning method that uses RBMs.
Code (0)
등록된 구현이 없습니다.
Tasks
reinforcement-learningReinforcement LearningReinforcement Learning (RL)Methods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Using Quantum Solved Deep Boltzmann Machines to Increase the Data Efficiency of RL Agents
Deep Learning algorithms, such as those used in Reinforcement Learning, often require large quantities of data to train effectively. In most cases, the availability of data is not a significant issue. However, for some c…
Quantum Machine Learningreinforcement-learningReinforcement LearningQuantum Boltzmann Machines for Sample-Efficient Reinforcement Learning
We introduce theoretically grounded Continuous Semi-Quantum Boltzmann Machines (CSQBMs) that supports continuous-action reinforcement learning. By combining exponential-family priors over visible units with quantum Boltz…
Reinforcement LearningContinuous ControlReinforcement Learning via Replica Stacking of Quantum Measurements for the Training of Quantum Boltzmann Machines
Recent theoretical and experimental results suggest the possibility of using current and near-future quantum hardware in challenging sampling tasks. In this paper, we introduce free-energy-based reinforcement learning (F…
reinforcement-learningReinforcement LearningReinforcement Learning (RL)Towards Multi-Agent Reinforcement Learning using Quantum Boltzmann Machines
Reinforcement learning has driven impressive advances in machine learning. Simultaneously, quantum-enhanced machine learning algorithms using quantum annealing underlie heavy developments. Recently, a multi-agent reinfor…
BIG-bench Machine LearningDeep Reinforcement LearningMulti-agent Reinforcement Learningreinforcement-learning+2Generative training of quantum Boltzmann machines with hidden units
In this article we provide a method for fully quantum generative training of quantum Boltzmann machines with both visible and hidden units while using quantum relative entropy as an objective. This is significant because…