Quantum framework for Reinforcement Learning: Integrating Markov decision process, quantum arithmetic, and trajectory search

2024-12-24 · Thet Htar Su, Shaswot Shresthamali, Masaaki Kondo

This paper introduces a quantum framework for addressing reinforcement learning (RL) tasks, grounded in the quantum principles and leveraging a fully quantum model of the classical Markov decision process (MDP). By employing quantum concepts and a quantum search algorithm, this work presents the implementation and optimization of the agent-environment interactions entirely within the quantum domain, eliminating reliance on classical computations. Key contributions include the quantum-based state transitions, return calculation, and trajectory search mechanism that utilize quantum principles to demonstrate the realization of RL processes through quantum phenomena. The implementation emphasizes the fundamental role of quantum superposition in enhancing computational efficiency for RL tasks. Results demonstrate the capacity of a quantum model to achieve quantum enhancement in RL, highlighting the potential of fully quantum implementations in decision-making tasks. This work not only underscores the applicability of quantum computing in machine learning but also contributes to the field of quantum reinforcement learning (QRL) by offering a robust framework for understanding and exploiting quantum computing in RL systems.

📄 PDF Abstract BibTeX arXiv:2412.18208

Code (0)

등록된 구현이 없습니다.

Tasks

Computational Efficiency Decision Making reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Quantum Speedups in Regret Analysis of Infinite Horizon Average-Reward Markov Decision Processes

2023-10-18 · Bhargav Ganguly, Yang Xu, Vaneet Aggarwal

This paper investigates the potential of quantum acceleration in addressing infinite horizon Markov Decision Processes (MDPs) to enhance average reward outcomes. We introduce an innovative quantum framework for the agent…

reinforcement-learning Reinforcement Learning

On the convergence of projective-simulation-based reinforcement learning in Markov decision processes

2019-10-25 · Walter L. Boyajian, Jens Clausen, Lea M. Trenkwalder, Vedran Dunjko 외

In recent years, the interest in leveraging quantum effects for enhancing machine learning tasks has significantly increased. Many algorithms speeding up supervised and unsupervised learning were established. The first f…

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

K-spin Hamiltonian for quantum-resolvable Markov decision processes

2020-04-13 · Eric B. Jones, Peter Graf, Eliot Kapit, Wesley Jones

The Markov decision process is the mathematical formalization underlying the modern field of reinforcement learning when transition and reward functions are unknown. We derive a pseudo-Boolean cost function that is equiv…

Q-Learning Reinforcement Learning Reinforcement Learning (RL)

Quantum Logic Gate Synthesis as a Markov Decision Process

2019-12-27 · M. Sohaib Alam, Noah F. Berthusen, Peter P. Orth

Reinforcement learning has witnessed recent applications to a variety of tasks in quantum programming. The underlying assumption is that those tasks could be modeled as Markov Decision Processes (MDPs). Here, we investig…

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Challenges for Reinforcement Learning in Quantum Circuit Design

2023-12-18 · Philipp Altmann, Jonas Stein, Michael Kölle, Adelina Bärligea 외

Quantum computing (QC) in the current NISQ era is still limited in size and precision. Hybrid applications mitigating those shortcomings are prevalent to gain early insight and advantages. Hybrid quantum machine learning…

Quantum Machine Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)