Policy Fusion for Adaptive and Customizable Reinforcement Learning Agents

2021-04-21 · Alessandro Sestini, Alexander Kuhnle, Andrew D. Bagdanov

In this article we study the problem of training intelligent agents using Reinforcement Learning for the purpose of game development. Unlike systems built to replace human players and to achieve super-human performance, our agents aim to produce meaningful interactions with the player, and at the same time demonstrate behavioral traits as desired by game designers. We show how to combine distinct behavioral policies to obtain a meaningful "fusion" policy which comprises all these behaviors. To this end, we propose four different policy fusion methods for combining pre-trained policies. We further demonstrate how these methods can be used in combination with Inverse Reinforcement Learning in order to create intelligent agents with specific behavioral styles as chosen by game designers, without having to define many and possibly poorly-designed reward functions. Experiments on two different environments indicate that entropy-weighted policy fusion significantly outperforms all others. We provide several practical examples and use-cases for how these methods are indeed useful for video game production and designers.

📄 PDF Abstract BibTeX arXiv:2104.10610

Code (0)

등록된 구현이 없습니다.

Tasks

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Measuring Policy Distance for Multi-Agent Reinforcement Learning

2024-01-20 · Tianyi Hu, Zhiqiang Pu, Xiaolin Ai, Tenghai Qiu 외

Diversity plays a crucial role in improving the performance of multi-agent reinforcement learning (MARL). Currently, many diversity-based methods have been developed to overcome the drawbacks of excessive parameter shari…

Diversity Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning

Multi-Agent Reinforcement Learning with Focal Diversity Optimization

2025-02-06 · Selim Furkan Tekin, Fatih Ilhan, Tiansheng Huang, Sihao Hu 외

The advancement of Large Language Models (LLMs) and their finetuning strategies has triggered the renewed interests in multi-agent reinforcement learning. In this paper, we introduce a focal diversity-optimized multi-age…

Diversity Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning+1

CODA: Coordination via On-Policy Diffusion for Multi-Agent Offline Reinforcement Learning

2026-04-25 · Marcel Hedman, Kale-ab Abebe Tessera, Juan Claude Formanek, Anya Sims 외 arxiv

Offline multi-agent reinforcement learning (MARL) enables policy learning from fixed datasets, but is prone to coordination failure: agents trained on static, off-policy data converge to suboptimal joint behaviours becau…

Multi-agent Reinforcement Learning Data Augmentation

PowerGridworld: A Framework for Multi-Agent Reinforcement Learning in Power Systems

2021-11-10 · David Biagioni, Xiangyu Zhang, Dylan Wald, Deepthi Vaidhynathan 외

We present the PowerGridworld software package to provide users with a lightweight, modular, and customizable framework for creating power-systems-focused, multi-agent Gym environments that readily integrate with existin…

Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning (RL)

APES: a Python toolbox for simulating reinforcement learning environments

2018-08-31 · Aqeel Labash, Ardi Tampuu, Tambet Matiisen, Jaan Aru 외

Assisted by neural networks, reinforcement learning agents have been able to solve increasingly complex tasks over the last years. The simulation environment in which the agents interact is an essential component in any …