Reward Shaping for Improved Learning in Real-time Strategy Game Play

2023-11-27 · John Kliem, Prithviraj Dasgupta

We investigate the effect of reward shaping in improving the performance of reinforcement learning in the context of the real-time strategy, capture-the-flag game. The game is characterized by sparse rewards that are associated with infrequently occurring events such as grabbing or capturing the flag, or tagging the opposing player. We show that appropriately designed reward shaping functions applied to different game events can significantly improve the player's performance and training times of the player's learning algorithm. We have validated our reward shaping functions within a simulated environment for playing a marine capture-the-flag game between two players. Our experimental results demonstrate that reward shaping can be used as an effective means to understand the importance of different sub-tasks during game-play towards winning the game, to encode a secondary objective functions such as energy efficiency into a player's game-playing behavior, and, to improve learning generalizable policies that can perform well against different skill levels of the opponent.

📄 PDF Abstract BibTeX arXiv:2311.16339

Code (0)

등록된 구현이 없습니다.

A Narration-based Reward Shaping Approach using Grounded Natural Language Commands

2019-10-31 · Nicholas Waytowich, Sean L. Barton, Vernon Lawhern, Garrett Warnell

While deep reinforcement learning techniques have led to agents that are successfully able to learn to perform a number of tasks that had been previously unlearnable, these techniques are still susceptible to the longsta…

Deep Reinforcement Learning Reinforcement Learning Starcraft Starcraft II

Action Guidance: Getting the Best of Sparse Rewards and Shaped Rewards for Real-time Strategy Games

2020-10-05 · Shengyi Huang, Santiago Ontañón

Training agents using Reinforcement Learning in games with sparse rewards is a challenging problem, since large amounts of exploration are required to retrieve even the first reward. To tackle this problem, a common appr…

Real-Time Strategy Games Reinforcement Learning (RL)

Reward Shaping via Meta-Learning

2019-01-27 · Haosheng Zou, Tongzheng Ren, Dong Yan, Hang Su 외

Reward shaping is one of the most effective methods to tackle the crucial yet challenging problem of credit assignment in Reinforcement Learning (RL). However, designing shaping functions usually requires much expert kno…

Meta-Learning Reinforcement Learning Reinforcement Learning (RL)

Obstacle Avoidance and Navigation Utilizing Reinforcement Learning with Reward Shaping

2020-03-28 · Daniel Zhang, Colleen P. Bailey

In this paper, we investigate the obstacle avoidance and navigation problem in the robotic control area. For solving such a problem, we propose revised Deep Deterministic Policy Gradient (DDPG) and Proximal Policy Optimi…

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Learning to Dynamically Select Between Reward Shaping Signals

2021-01-01 · Alexander Politowicz, Bing Liu

Reinforcement learning (RL) algorithms often have the limitation of sample complexity. Previous research has shown that the reliance on large amounts of experience can be mitigated through the presence of additional feed…

Reinforcement Learning (RL)