Efficient Evolutionary Methods for Game Agent Optimisation: Model-Based is Best
This paper introduces a simple and fast variant of Planet Wars as a test-bed for statistical planning based Game AI agents, and for noisy hyper-parameter optimisation. Planet Wars is a real-time strategy game with simple rules but complex game-play. The variant introduced in this paper is designed for speed to enable efficient experimentation, and also for a fixed action space to enable practical inter-operability with General Video Game AI agents. If we treat the game as a win-loss game (which is standard), then this leads to challenging noisy optimisation problems both in tuning agents to play the game, and in tuning game parameters. Here we focus on the problem of tuning an agent, and report results using the recently developed N-Tuple Bandit Evolutionary Algorithm and a number of other optimisers, including Sequential Model-based Algorithm Configuration (SMAC). Results indicate that the N-Tuple Bandit Evolutionary offers competitive performance as well as insight into the effects of combinations of parameter choices.
Code (1)
Tasks
SMACSMAC+Similar Papers 제목 키워드 기반
The N-Tuple Bandit Evolutionary Algorithm for Game Agent Optimisation
This paper describes the N-Tuple Bandit Evolutionary Algorithm (NTBEA), an optimisation algorithm developed for noisy and expensive discrete (combinatorial) optimisation problems. The algorithm is applied to two game-bas…
Rolling Horizon Evolutionary Algorithms for General Video Game Playing
Game-playing Evolutionary Algorithms, specifically Rolling Horizon Evolutionary Algorithms, have recently managed to beat the state of the art in win rate across many video games. However, the best results in a game are …
Evolutionary AlgorithmsOptimizing Hearthstone Agents using an Evolutionary Algorithm
Digital collectible card games are not only a growing part of the video game industry, but also an interesting research area for the field of computational intelligence. This game genre allows researchers to deal with hi…
Card GamesDecision MakingEvolutionary AlgorithmsSelf-LearningThe N-Tuple Bandit Evolutionary Algorithm for Automatic Game Improvement
This paper describes a new evolutionary algorithm that is especially well suited to AI-Assisted Game Design. The approach adopted in this paper is to use observations of AI agents playing the game to estimate the game's …
Game DesignIEO: Intelligent Evolutionary Optimisation for Hyperparameter Tuning
Hyperparameter optimisation is a crucial process in searching the optimal machine learning model. The efficiency of finding the optimal hyperparameter settings has been a big concern in recent researches since the optimi…
BIG-bench Machine Learning