Deep Reinforcement Learning for Navigation in AAA Video Games

2020-11-09 · Eloi Alonso, Maxim Peter, David Goumard, Joshua Romoff

In video games, non-player characters (NPCs) are used to enhance the players' experience in a variety of ways, e.g., as enemies, allies, or innocent bystanders. A crucial component of NPCs is navigation, which allows them to move from one point to another on the map. The most popular approach for NPC navigation in the video game industry is to use a navigation mesh (NavMesh), which is a graph representation of the map, with nodes and edges indicating traversable areas. Unfortunately, complex navigation abilities that extend the character's capacity for movement, e.g., grappling hooks, jetpacks, teleportation, or double-jumps, increases the complexity of the NavMesh, making it intractable in many practical scenarios. Game designers are thus constrained to only add abilities that can be handled by a NavMesh if they want to have NPC navigation. As an alternative, we propose to use Deep Reinforcement Learning (Deep RL) to learn how to navigate 3D maps using any navigation ability. We test our approach on complex 3D environments in the Unity game engine that are notably an order of magnitude larger than maps typically used in the Deep RL literature. One of these maps is directly modeled after a Ubisoft AAA game. We find that our approach performs surprisingly well, achieving at least $90\%$ success rate on all tested scenarios. A video of our results is available at https://youtu.be/WFIf9Wwlq8M.

📄 PDF Abstract BibTeX arXiv:2011.04764

Code (0)

등록된 구현이 없습니다.

Tasks

Deep Reinforcement LearningNavigatereinforcement-learning Reinforcement Learning Reinforcement Learning (RL)Unity

DRLViz: Understanding Decisions and Memory in Deep Reinforcement Learning

2019-09-06 · Theo Jaunet, Romain Vuillemot, Christian Wolf

We present DRLViz, a visual analytics interface to interpret the internal memory of an agent (e.g. a robot) trained using deep reinforcement learning. This memory is composed of large temporal vectors updated when the ag…

Deep Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Graph augmented Deep Reinforcement Learning in the GameRLand3D environment

2021-12-22 · Edward Beeching, Maxim Peter, Philippe Marcotte, Jilles Debangoye 외

We address planning and navigation in challenging 3D video games featuring maps with disconnected regions reachable by agents using special actions. In this setting, classical symbolic planners are not applicable or diff…

Deep Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Depth-CUPRL: Depth-Imaged Contrastive Unsupervised Prioritized Representations in Reinforcement Learning for Mapless Navigation of Unmanned Aerial Vehicles

2022-06-30 · Junior Costa de Jesus, Victor Augusto Kich, Alisson Henrique Kolling, Ricardo Bedin Grando 외

Reinforcement Learning (RL) has presented an impressive performance in video games through raw pixel imaging and continuous control tasks. However, RL performs poorly with high-dimensional observations such as raw pixel …

continuous-control Continuous Control Contrastive Learning Decision Making+3

Training Interactive Agent in Large FPS Game Map with Rule-enhanced Reinforcement Learning

2024-10-07 · Chen Zhang, Huan Hu, Yuan Zhou, Qiyang Cao 외

In the realm of competitive gaming, 3D first-person shooter (FPS) games have gained immense popularity, prompting the development of game AI systems to enhance gameplay. However, deploying game AI in practical scenarios …

Deep Reinforcement Learning FPS Games

Human-Like Navigation Behavior: A Statistical Evaluation Framework

2022-03-10 · Ian Colbert, Mehdi Saeedi

Recent advancements in deep reinforcement learning have brought forth an impressive display of highly skilled artificial agents capable of complex intelligent behavior. In video games, these artificial agents are increas…

Deep Reinforcement Learning