A quantum-classical reinforcement learning model to play Atari games

2024-12-11 · Dominik Freinberger, Julian Lemmel, Radu Grosu, Sofiene Jerbi

Recent advances in reinforcement learning have demonstrated the potential of quantum learning models based on parametrized quantum circuits as an alternative to deep learning models. On the one hand, these findings have shown the ultimate exponential speed-ups in learning that full-blown quantum models can offer in certain -- artificially constructed -- environments. On the other hand, they have demonstrated the ability of experimentally accessible PQCs to solve OpenAI Gym benchmarking tasks. However, it remains an open question whether these near-term QRL techniques can be successfully applied to more complex problems exhibiting high-dimensional observation spaces. In this work, we bridge this gap and present a hybrid model combining a PQC with classical feature encoding and post-processing layers that is capable of tackling Atari games. A classical model, subjected to architectural restrictions similar to those present in the hybrid model is constructed to serve as a reference. Our numerical investigation demonstrates that the proposed hybrid model is capable of solving the Pong environment and achieving scores comparable to the classical reference in Breakout. Furthermore, our findings shed light on important hyperparameter settings and design choices that impact the interplay of the quantum and classical components. This work contributes to the understanding of near-term quantum learning models and makes an important step towards their deployment in real-world RL scenarios.

📄 PDF Abstract BibTeX arXiv:2412.08725

Code (1)

Spiegeldondi/A-Hybrid-Quantum-Classical-Framework-for-Reinforcement-Learning-of-Atari-Games 공식 구현 tf

Tasks

Atari Games Benchmarking OpenAI Gym

Deep Reinforcement Learning with Quantum-inspired Experience Replay

2021-01-06 · Qing Wei, Hailan Ma, Chunlin Chen, Daoyi Dong

In this paper, a novel training paradigm inspired by quantum computation is proposed for deep reinforcement learning (DRL) with experience replay. In contrast to traditional experience replay mechanism in DRL, the propos…

Atari Games Deep Reinforcement Learning Diversity reinforcement-learning+2

Playing Atari Games with Deep Reinforcement Learning and Human Checkpoint Replay

2016-07-18 · Ionel-Alexandru Hosu, Traian Rebedea

This paper introduces a novel method for learning how to play the most difficult Atari 2600 games from the Arcade Learning Environment using deep reinforcement learning. The proposed method, human checkpoint replay, cons…

Atari Games Deep Reinforcement Learning Montezuma's Revenge reinforcement-learning+2

Enhancing Two-Player Performance Through Single-Player Knowledge Transfer: An Empirical Study on Atari 2600 Games

2024-10-22 · Kimiya Saadat, Richard Zhao

Playing two-player games using reinforcement learning and self-play can be challenging due to the complexity of two-player environments and the possible instability in the training process. We propose that a reinforcemen…

Atari Games reinforcement-learning Reinforcement Learning Transfer Learning

Learning To Play Atari Games Using Dueling Q-Learning and Hebbian Plasticity

2024-05-22 · Md Ashfaq Salehin

In this work, an advanced deep reinforcement learning architecture is used to train neural network agents playing atari games. Given only the raw game pixels, action space, and reward information, the system can train ag…

Atari Games Deep Reinforcement Learning Lifelong learning Q-Learning

Reinforcement Learning in Strategy-Based and Atari Games: A Review of Google DeepMinds Innovations

2025-02-14 · Abdelrhman Shaheen, Anas Badr, Ali Abohendy, Hatem Alsaadawy 외

Reinforcement Learning (RL) has been widely used in many applications, particularly in gaming, which serves as an excellent training ground for AI models. Google DeepMind has pioneered innovations in this field, employin…

Atari Games Game of Go reinforcement-learning Reinforcement Learning+1