paper-with-me

Papers

AlphaViT: A Flexible Game-Playing AI for Multiple Games and Variable Board Sizes

2024-08-25 · Kazuhisa Fujita

This paper presents novel game-playing AI agents based on the AlphaZero framework, enhanced with Vision Transformer (ViT): AlphaViT, AlphaViD, and AlphaVDA. These agents are designed to play multiple board games of various sizes using a single network with shared weights, thereby overcoming AlphaZero's limitation of fixed-board-size constraints. AlphaViT employs only a transformer encoder, whereas AlphaViD and AlphaVDA incorporate both transformer encoders and decoders. In AlphaViD, the decoder processes outputs from the encoder, whereas AlphaVDA uses a learnable embeddings as the decoder input. The additional decoder layers in AlphaViD and AlphaVDA provide flexibility to adapt to various action spaces and board sizes. Experimental results show that the proposed agents, trained on either individual games or multiple games simultaneously, consistently outperform traditional algorithms such as Minimax and Monte Carlo Tree Search and approach the performance of AlphaZero, despite using a single deep neural network (DNN) with shared weights. In particular, AlphaViT shows strong performance across all tested games. Furthermore, fine-tuning the DNN using pre-trained weights from small-board games accelerates convergence and improves performance, particularly in Gomoku. Interestingly, simultaneous training on multiple games yields performance comparable to, or even surpassing, single-game training. These results indicate the potential of transformer-based architectures to develop more flexible and robust game-playing AI agents that excel in multiple games and dynamic environments.

📄 PDF Abstract BibTeX arXiv:2408.13871

Code (1)

kazuhisafujita/alphavit 공식 구현 pytorch

Tasks

Board GamesDecoder

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Residual Connection 설명 없음
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Adam 설명 없음
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.

Similar Papers 제목 키워드 기반

Thespian: Multi-Character Text Role-Playing Game Agents

2023-08-03 · Christopher Cui, Xiangyu Peng, Mark Riedl

Text-adventure games and text role-playing games are grand challenges for reinforcement learning game playing agents. Text role-playing games are open-ended environments where an agent must faithfully play a particular c…

Few-Shot Learning

Evolutionary Machine Learning and Games

2023-11-20 · Julian Togelius, Ahmed Khalifa, Sam Earle, Michael Cerny Green 외

Evolutionary machine learning (EML) has been applied to games in multiple ways, and for multiple different purposes. Importantly, AI research in games is not only about playing games; it is also about generating game con…

Biasing MCTS with Features for General Games

2019-03-21 · Dennis J. N. J. Soemers, Éric Piette, Cameron Browne

This paper proposes using a linear function approximator, rather than a deep neural network (DNN), to bias a Monte Carlo tree search (MCTS) player for general games. This is unlikely to match the potential raw playing st…

Board Games

Best-response dynamics, playing sequences, and convergence to equilibrium in random games

2021-01-11 · Torsten Heinrich, Yoojin Jang, Luca Mungo, Marco Pangallo 외

We analyze the performance of the best-response dynamic across all normal-form games using a random games approach. The playing sequence -- the order in which players update their actions -- is essentially irrelevant in …

All

General Video Game AI: a Multi-Track Framework for Evaluating Agents, Games and Content Generation Algorithms

2018-02-28 · Diego Perez-Liebana, Jialin Liu, Ahmed Khalifa, Raluca D. Gaina 외

General Video Game Playing (GVGP) aims at designing an agent that is capable of playing multiple video games with no human intervention. In 2014, The General Video Game AI (GVGAI) competition framework was created and re…