Combining Evolutionary Search with Behaviour Cloning for Procedurally Generated Content
In this work, we consider the problem of procedural content generation for video game levels. Prior approaches have relied on evolutionary search (ES) methods capable of generating diverse levels, but this generation procedure is slow, which is problematic in real-time settings. Reinforcement learning (RL) has also been proposed to tackle the same problem, and while level generation is fast, training time can be prohibitively expensive. We propose a framework to tackle the procedural content generation problem that combines the best of ES and RL. In particular, our approach first uses ES to generate a sequence of levels evolved over time, and then uses behaviour cloning to distil these levels into a policy, which can then be queried to produce new levels quickly. We apply our approach to a maze game and Super Mario Bros, with our results indicating that our approach does in fact decrease the time required for level generation, especially when an increasing number of valid levels are required.
Code (0)
등록된 구현이 없습니다.
Tasks
Reinforcement Learning (RL)validSimilar Papers 제목 키워드 기반
Improving Behavioural Cloning with Human-Driven Dynamic Dataset Augmentation
Behavioural cloning has been extensively used to train agents and is recognized as a fast and solid approach to teach general behaviours based on expert trajectories. Such method follows the supervised learning paradigm …
Behavioural cloningGeneric Behaviour Similarity Measures for Evolutionary Swarm Robotics
Novelty search has shown to be a promising approach for the evolution of controllers for swarm robotics. In existing studies, however, the experimenter had to craft a domain dependent behaviour similarity measure to use …
Procedural Content Generation using Neuroevolution and Novelty Search for Diverse Video Game Levels
Procedurally generated video game content has the potential to drastically reduce the content creation budget of game developers and large studios. However, adoption is hindered by limitations such as slow generation, as…
DiversityEvolutionary game theory: the mathematics of evolution and collective behaviours
This brief discusses evolutionary game theory as a powerful and unified mathematical tool to study evolution of collective behaviours. It summarises some of my recent research directions using evolutionary game theory me…
Evolutionary Image Transition Based on Theoretical Insights of Random Processes
Evolutionary algorithms have been widely studied from a theoretical perspective. In particular, the area of runtime analysis has contributed significantly to a theoretical understanding and provided insights into the wor…
Evolutionary Algorithms