Research on reinforcement learning based warehouse robot navigation algorithm in complex warehouse layout

2024-11-09 · Keqin Li, Lipeng Liu, Jiajing Chen, Dezhi Yu, Xiaofan Zhou, Ming Li, Congyu Wang, Zhao Li

In this paper, how to efficiently find the optimal path in complex warehouse layout and make real-time decision is a key problem. This paper proposes a new method of Proximal Policy Optimization (PPO) and Dijkstra's algorithm, Proximal policy-Dijkstra (PP-D). PP-D method realizes efficient strategy learning and real-time decision making through PPO, and uses Dijkstra algorithm to plan the global optimal path, thus ensuring high navigation accuracy and significantly improving the efficiency of path planning. Specifically, PPO enables robots to quickly adapt and optimize action strategies in dynamic environments through its stable policy updating mechanism. Dijkstra's algorithm ensures global optimal path planning in static environment. Finally, through the comparison experiment and analysis of the proposed framework with the traditional algorithm, the results show that the PP-D method has significant advantages in improving the accuracy of navigation prediction and enhancing the robustness of the system. Especially in complex warehouse layout, PP-D method can find the optimal path more accurately and reduce collision and stagnation. This proves the reliability and effectiveness of the robot in the study of complex warehouse layout navigation algorithm.

📄 PDF Abstract BibTeX arXiv:2411.06128

Code (0)

등록된 구현이 없습니다.

Tasks

Decision Making Robot Navigation

Methods 이 논문이 사용한 방법론

Entropy Regularization 설명 없음

PPO Proximal Policy Optimization, or PPO, is a policy gradient method for reinforcement learning. The motivation was to have an algorithm with the data efficiency and reliable…

NavVI: A Telerobotic Simulation with Multimodal Feedback for Visually Impaired Navigation in Warehouse Environments

2025-07-20 · Maisha Maimuna, Minhaz Bin Farukee, Sama Nikanfar, Mahfuza Siddiqua 외 arxiv

Industrial warehouses are congested with moving forklifts, shelves and personnel, making robot teleoperation particularly risky and demanding for blind and low-vision (BLV) operators. Although accessible teleoperation pl…

DC-MRTA: Decentralized Multi-Robot Task Allocation and Navigation in Complex Environments

2022-09-07 · Aakriti Agrawal, Senthil Hariharan, Amrit Singh Bedi, Dinesh Manocha

We present a novel reinforcement learning (RL) based task allocation and decentralized navigation algorithm for mobile robots in warehouse environments. Our approach is designed for scenarios in which multiple robots are…

Reinforcement Learning (RL)

Autonomous Warehouse Robot using Deep Q-Learning

2022-02-21 · Ismot Sadik Peyas, Zahid Hasan, Md. Rafat Rahman Tushar, Al Musabbir 외

In warehouses, specialized agents need to navigate, avoid obstacles and maximize the use of space in the warehouse environment. Due to the unpredictability of these environments, reinforcement learning approaches can be …

Deep Reinforcement Learning Navigate Q-Learning reinforcement-learning+3

Deep Reinforcement Learning-based Obstacle Avoidance for Robot Movement in Warehouse Environments

2024-09-23 · Keqin Li, Jiajing Chen, Denzhi Yu, Tao Dajun 외

At present, in most warehouse environments, the accumulation of goods is complex, and the management personnel in the control of goods at the same time with the warehouse mobile robot trajectory interaction, the traditio…

Deep Reinforcement Learning reinforcement-learning Reinforcement Learning

Arena-Web -- A Web-based Development and Benchmarking Platform for Autonomous Navigation Approaches

2023-02-06 · Linh Kästner, Reyk Carstens, Christopher Liebig, Volodymyr Shcherbyna 외

In recent years, mobile robot navigation approaches have become increasingly important due to various application areas ranging from healthcare to warehouse logistics. In particular, Deep Reinforcement Learning approache…

Autonomous Navigation Benchmarking Deep Reinforcement Learning reinforcement-learning+3