Quantum deep reinforcement learning for humanoid robot navigation task

2025-09-14 · Romerik Lokossou, Birhanu Shimelis Girma, Ozan K. Tonguz, Ahmed Biyabani arxiv

Classical reinforcement learning (RL) methods often struggle in complex, high-dimensional environments because of their extensive parameter requirements and challenges posed by stochastic, non-deterministic settings. This study introduces quantum deep reinforcement learning (QDRL) to train humanoid agents efficiently. While previous quantum RL models focused on smaller environments, such as wheeled robots and robotic arms, our work pioneers the application of QDRL to humanoid robotics, specifically in environments with substantial observation and action spaces, such as MuJoCo's Humanoid-v4 and Walker2d-v4. Using parameterized quantum circuits, we explored a hybrid quantum-classical setup to directly navigate high-dimensional state spaces, bypassing traditional mapping and planning. By integrating quantum computing with deep RL, we aim to develop models that can efficiently learn complex navigation tasks in humanoid robots. We evaluated the performance of the Soft Actor-Critic (SAC) in classical RL against its quantum implementation. The results show that the quantum SAC achieves an 8% higher average return (246.40) than the classical SAC (228.36) after 92% fewer steps, highlighting the accelerated learning potential of quantum computing in RL tasks.

📄 PDF Abstract BibTeX arXiv:2509.11388

Code (0)

등록된 구현이 없습니다.

Tasks

Reinforcement Learning Robot Navigation

Multi-Agent Hierarchical Reinforcement Learning for Humanoid Navigation

2019-09-25 · Glen Berseth, Brandon haworth, Seonghyeon Moon, Mubbasir Kapadia 외

Multi-agent reinforcement learning is a particularly challenging problem. Current methods have made progress on cooperative and competitive environments with particle-based agents. Little progress has been made on soluti…

Collision Avoidance Hierarchical Reinforcement Learning Multi-agent Reinforcement Learning reinforcement-learning+3

Quantum Deep Reinforcement Learning for Robot Navigation Tasks

2022-02-24 · Hans Hohenfeld, Dirk Heimann, Felix Wiebe, Frank Kirchner

We utilize hybrid quantum deep reinforcement learning to learn navigation tasks for a simple, wheeled robot in simulated environments of increasing complexity. For this, we train parameterized quantum circuits (PQCs) wit…

BIG-bench Machine Learning Deep Reinforcement Learning OpenAI Gym Quantum Machine Learning+4

GuideWalk: Learning Unified Autonomous Navigation and Locomotion for Humanoid Robots across Versatile Terrains

2026-06-09 · Haoxuan Han, Chen Chen, Linao Gong, Xin Yang 외 arxiv

Humanoid robots have achieved strong locomotion capabilities, but reliable navigation on versatile terrains remains challenging because obstacle avoidance must be coordinated with dynamically feasible motion. In this wor…

Reinforcement Learning

End-to-End Humanoid Robot Safe and Comfortable Locomotion Policy

2025-08-11 · Zifan Wang, Xun Yang, Jianzhuang Zhao, Jiaming Zhou 외 arxiv

The deployment of humanoid robots in unstructured, human-centric environments requires navigation capabilities that extend beyond simple locomotion to include robust perception, provable safety, and socially aware behavi…

Reinforcement Learning Point Clouds

Q-SpiRL: Quantum Spiking Reinforcement Learning for Adaptive Robot Navigation

2026-05-20 · Mohamed Khair Altrabulsi, Nouhaila Innan, Alberto Marchisio, Muhammad Kashif 외 arxiv

Adaptive robot navigation in dynamic environments requires policies that can reach the target reliably while producing efficient and stable trajectories. This paper presents Q-SpiRL, a quantum spiking reinforcement learn…