DanZero: Mastering GuanDan Game with Reinforcement Learning

2022-10-31 · Yudong Lu, Jian Zhao, Youpeng Zhao, Wengang Zhou, Houqiang Li

Card game AI has always been a hot topic in the research of artificial intelligence. In recent years, complex card games such as Mahjong, DouDizhu and Texas Hold'em have been solved and the corresponding AI programs have reached the level of human experts. In this paper, we are devoted to developing an AI program for a more complex card game, GuanDan, whose rules are similar to DouDizhu but much more complicated. To be specific, the characteristics of large state and action space, long length of one episode and the unsure number of players in the GuanDan pose great challenges for the development of the AI program. To address these issues, we propose the first AI program DanZero for GuanDan using reinforcement learning technique. Specifically, we utilize a distributed framework to train our AI system. In the actor processes, we carefully design the state features and agents generate samples by self-play. In the learner process, the model is updated by Deep Monte-Carlo Method. After training for 30 days using 160 CPUs and 1 GPU, we get our DanZero bot. We compare it with 8 baseline AI programs which are based on heuristic rules and the results reveal the outstanding performance of DanZero. We also test DanZero with human players and demonstrate its human-level performance.

📄 PDF Abstract BibTeX arXiv:2210.17087

Code (0)

등록된 구현이 없습니다.

Tasks

Card GamesGPUreinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Methods 이 논문이 사용한 방법론

Test 설명 없음

DanZero+: Dominating the GuanDan Game through Reinforcement Learning

2023-12-05 · Youpeng Zhao, Yudong Lu, Jian Zhao, Wengang Zhou 외

The utilization of artificial intelligence (AI) in card games has been a well-explored subject within AI research for an extensive period. Recent advancements have propelled AI programs to showcase expertise in intricate…

Card Games reinforcement-learning Reinforcement Learning

Mastering the Game of Guandan with Deep Reinforcement Learning and Behavior Regulating

2024-02-21 · Yifan Yanggong, Hao Pan, Lei Wang

Games are a simplified model of reality and often serve as a favored platform for Artificial Intelligence (AI) research. Much of the research is concerned with game-playing agents and their decision making processes. The…

Decision Making Deep Reinforcement Learning

OpenGuanDan: A Large-Scale Imperfect Information Game Benchmark

2026-01-31 · Chao Li, Shangdong Yang, Chiheng Zhan, Zhenxing Ge 외 arxiv

The advancement of data-driven artificial intelligence (AI), particularly machine learning, heavily depends on large-scale benchmarks. Despite remarkable progress across domains ranging from pattern recognition to intell…

Enhancing Commentary Strategies for Imperfect Information Card Games: A Study of Large Language Models in Guandan Commentary

2024-06-23 · Meiling Tao, Xuechen Liang, Xinyuan Song, Yangfan He 외

Recent advancements in large language models (LLMs) have unlocked the potential for generating high-quality game commentary. However, producing insightful and engaging commentary for complex games with incomplete informa…

Card Games Reinforcement Learning (RL)Retrieval

Evaluating and Enhancing LLMs Agent based on Theory of Mind in Guandan: A Multi-Player Cooperative Game under Imperfect Information

2024-08-05

Large language models (LLMs) have shown success in handling simple games with imperfect information and enabling multi-agent coordination, but their ability to facilitate practical collaboration against other agents in c…