AlphaStar: An Evolutionary Computation Perspective

2019-02-05 · Kai Arulkumaran, Antoine Cully, Julian Togelius

In January 2019, DeepMind revealed AlphaStar to the world-the first artificial intelligence (AI) system to beat a professional player at the game of StarCraft II-representing a milestone in the progress of AI. AlphaStar draws on many areas of AI research, including deep learning, reinforcement learning, game theory, and evolutionary computation (EC). In this paper we analyze AlphaStar primarily through the lens of EC, presenting a new look at the system and relating it to many concepts in the field. We highlight some of its most interesting aspects-the use of Lamarckian evolution, competitive co-evolution, and quality diversity. In doing so, we hope to provide a bridge between the wider EC community and one of the most significant AI systems developed in recent times.

📄 PDF Abstract BibTeX arXiv:1902.01724

Code (0)

등록된 구현이 없습니다.

Tasks

DiversityReinforcement Learning Reinforcement Learning (RL)Starcraft II

Methods 이 논문이 사용한 방법론

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.

Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…

Position-Wise Feed-Forward Layer 설명 없음

Average Pooling 설명 없음

Sigmoid Activation 설명 없음

Batch Normalization 설명 없음

1x1 Convolution A 1 x 1 Convolution is a convolution with some special properties in that it can be used for dimensionality reduction,…

Bottleneck Residual Block A Bottleneck Residual Block is a variant of the residual block that utilises 1x1 convolutions to create a bottleneck. The…

An Introduction of mini-AlphaStar

2021-04-14 · Ruo-Ze Liu, Wenhai Wang, Yanjie Shen, Zhiqi Li 외

StarCraft II (SC2) is a real-time strategy game in which players produce and control multiple units to fight against opponent's units. Due to its difficulties, such as huge state space, various action space, a long time …

Starcraft Starcraft II

TStarBot-X: An Open-Sourced and Comprehensive Study for Efficient League Training in StarCraft II Full Game

2020-11-27 · Lei Han, Jiechao Xiong, Peng Sun, Xinghai Sun 외

StarCraft, one of the most difficult esport games with long-standing history of professional tournaments, has attracted generations of players and fans, and also, intense attentions in artificial intelligence research. R…

AI Agent Imitation Learning Starcraft Starcraft II

A Robust and Opponent-Aware League Training Method for StarCraft II

2023-09-21 · NeurIPS 2023 11

It is extremely difficult to train a superhuman Artificial Intelligence (AI) for games of similar size to StarCraft II. AlphaStar is the first AI that beat human professionals in the full game of StarCraft II, using a le…

AlphaStar Unplugged: Large-Scale Offline Reinforcement Learning

2023-08-07 · Michaël Mathieu, Sherjil Ozair, Srivatsan Srinivasan, Caglar Gulcehre 외

StarCraft II is one of the most challenging simulated reinforcement learning environments; it is partially observable, stochastic, multi-agent, and mastering StarCraft II requires strategic planning over long time horizo…

Offline RL reinforcement-learning Reinforcement Learning Starcraft+1

Rethinking of AlphaStar

2021-08-07 · Ruo-Ze Liu

We present a different view for AlphaStar (AS), the program achieving Grand-Master level in the game StarCraft II. It is considered big progress for AI research. However, in this paper, we present problems with the AS, s…