홈 › Papers

Off-Beat Multi-Agent Reinforcement Learning

2022-05-27 · Wei Qiu, Weixun Wang, Rundong Wang, Bo An, Yujing Hu, Svetlana Obraztsova, Zinovi Rabinovich, Jianye Hao, Yingfeng Chen, Changjie Fan

We investigate model-free multi-agent reinforcement learning (MARL) in environments where off-beat actions are prevalent, i.e., all actions have pre-set execution durations. During execution durations, the environment changes are influenced by, but not synchronised with, action execution. Such a setting is ubiquitous in many real-world problems. However, most MARL methods assume actions are executed immediately after inference, which is often unrealistic and can lead to catastrophic failure for multi-agent coordination with off-beat actions. In order to fill this gap, we develop an algorithmic framework for MARL with off-beat actions. We then propose a novel episodic memory, LeGEM, for model-free MARL algorithms. LeGEM builds agents' episodic memories by utilizing agents' individual experiences. It boosts multi-agent learning by addressing the challenging temporal credit assignment problem raised by the off-beat actions via our novel reward redistribution scheme, alleviating the issue of non-Markovian reward. We evaluate LeGEM on various multi-agent scenarios with off-beat actions, including Stag-Hunter Game, Quarry Game, Afforestation Game, and StarCraft II micromanagement tasks. Empirical results show that LeGEM significantly boosts multi-agent coordination and achieves leading performance and improved sample efficiency.

📄 PDF Abstract BibTeX arXiv:2205.13718

Code (0)

등록된 구현이 없습니다.

Tasks

Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)StarcraftStarcraft II

Beating Atari with Natural Language Guided Reinforcement Learning

2017-04-18 · Russell Kaplan, Christopher Sauer, Alexander Sosa

We introduce the first deep reinforcement learning agent that learns to beat Atari games with the aid of natural language instructions. The agent uses a multimodal embedding between environment observations and natural l…

Atari Games Deep Reinforcement Learning Montezuma's Revenge OpenAI Gym+3

MimicBot: Combining Imitation and Reinforcement Learning to win in Bot Bowl

2021-08-21 · Nicola Pezzotti

This paper describe an hybrid agent trained to play in Fantasy Football AI which participated in the Bot Bowl III competition. The agent, MimicBot, is implemented using a specifically designed deep policy network and tra…

Decision Making Imitation Learning reinforcement-learning Reinforcement Learning+1

Reinforcement Learning Agents in Colonel Blotto

2022-04-04 · Joseph Christian G. Noel

Models and games are simplified representations of the world. There are many different kinds of models, all differing in complexity and which aspect of the world they allow us to further our understanding of. In this pap…

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Winning Isn't Everything: Enhancing Game Development with Intelligent Agents

2019-03-25 · Yunqi Zhao, Igor Borovikov, Fernando De Mesentier Silva, Ahmad Beirami 외

Recently, there have been several high-profile achievements of agents learning to play games against humans and beat them. In this paper, we study the problem of training intelligent agents in service of game development…

Deep Reinforcement Learning Reinforcement Learning

Entity Divider with Language Grounding in Multi-Agent Reinforcement Learning

2022-10-25 · Ziluo Ding, Wanpeng Zhang, Junpeng Yue, Xiangjun Wang 외

We investigate the use of natural language to drive the generalization of policies in multi-agent settings. Unlike single-agent settings, the generalization of policies should also consider the influence of other agents.…

Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)