Forward Modeling for Partial Observation Strategy Games - A StarCraft Defogger
We formulate the problem of defogging as state estimation and future state prediction from previous, partial observations in the context of real-time strategy games. We propose to employ encoder-decoder neural networks for this task, and introduce proxy tasks and baselines for evaluation to assess their ability of capturing basic game rules and high-level dynamics. By combining convolutional neural networks and recurrent networks, we exploit spatial and sequential correlations and train well-performing models on a large dataset of human games of StarCraft: Brood War. Finally, we demonstrate the relevance of our models to downstream tasks by applying them for enemy unit prediction in a state-of-the-art, rule-based StarCraft bot. We observe improvements in win rates against several strong community bots.
Code (1)
Tasks
DecoderReal-Time Strategy GamesStarcraftState EstimationSimilar Papers 제목 키워드 기반
Solving Large Extensive-Form Games with Strategy Constraints
Extensive-form games are a common model for multiagent interactions with imperfect information. In two-player zero-sum games, the typical solution concept is a Nash equilibrium over the unconstrained strategy set for eac…
counterfactualFormSecurity Games with Information Leakage: Modeling and Computation
Most models of Stackelberg security games assume that the attacker only knows the defender's mixed strategy, but is not able to observe (even partially) the instantiated pure strategy. Such partial observation of the dep…
Discriminative Particle Filter Reinforcement Learning for Complex Partial Observations
Deep reinforcement learning is successful in decision making for sophisticated games, such as Atari, Go, etc. However, real-world decision making often requires reasoning with partial information extracted from complex v…
Atari GamesDecision MakingDeep Reinforcement Learningreinforcement-learning+3FAMOS: Feed-Forward 3D Articulation Modeling from Sparse Observations
Modeling articulated objects from sparse monocular views is challenging because each observation reveals only partial geometry and motion evidence. Most feed-forward methods infer articulation from a single observation a…
Point CloudsHigh-Level Strategy Selection under Partial Observability in StarCraft: Brood War
We consider the problem of high-level strategy selection in the adversarial setting of real-time strategy games from a reinforcement learning perspective, where taking an action corresponds to switching to the respective…
Real-Time Strategy Gamesreinforcement-learningReinforcement LearningReinforcement Learning (RL)+2