Learning to Beat ByteRL: Exploitability of Collectible Card Game Agents
While Poker, as a family of games, has been studied extensively in the last decades, collectible card games have seen relatively little attention. Only recently have we seen an agent that can compete with professional human players in Hearthstone, one of the most popular collectible card games. Although artificial agents must be able to work with imperfect information in both of these genres, collectible card games pose another set of distinct challenges. Unlike in many poker variants, agents must deal with state space so vast that even enumerating all states consistent with the agent's beliefs is intractable, rendering the current search methods unusable and requiring the agents to opt for other techniques. In this paper, we investigate the strength of such techniques for this class of games. Namely, we present preliminary analysis results of ByteRL, the state-of-the-art agent in Legends of Code and Magic and Hearthstone. Although ByteRL beat a top-10 Hearthstone player from China, we show that its play in Legends of Code and Magic is highly exploitable.
Code (0)
등록된 구현이 없습니다.
Tasks
Card GamesMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Drafting in Collectible Card Games via Reinforcement Learning
Collectible card games are played by tens of millions of players worldwide. Their intricate rules and diverse cards make them much harder than traditional card games. To win, players must be proficient in two interdepend…
Card GamesDeep Reinforcement Learningreinforcement-learningReinforcement Learning+1A Taxonomy of Collectible Card Games from a Game-Playing AI Perspective
Collectible card games are challenging, widely played games that have received increasing attention from the AI research community in recent years. Despite important breakthroughs, the field still poses many unresolved c…
Card GamesQ-DeckRec: A Fast Deck Recommendation System for Collectible Card Games
Deck building is a crucial component in playing Collectible Card Games (CCGs). The goal of deck building is to choose a fixed-sized subset of cards from a large card pool, so that they work well together in-game against …
Card GamesEvolving Evaluation Functions for Collectible Card Game AI
In this work, we presented a study regarding two important aspects of evolving feature-based game evaluation functions: the choice of genome representation and the choice of opponent used to test the model. We compared t…
Card GamesThe Many AI Challenges of Hearthstone
Games have benchmarked AI methods since the inception of the field, with classic board games such as Chess and Go recently leaving room for video games with related yet different sets of challenges. The set of AI problem…
Board GamesCard Games