HLSMAC: A New StarCraft Multi-Agent Challenge for High-Level Strategic Decision-Making

2025-09-16 · Xingxing Hong, Yungong Wang, Dexin Jin, Ye Yuan, Ximing Huang, Zijian Wu, Wenxin Li arxiv

Benchmarks are crucial for assessing multi-agent reinforcement learning (MARL) algorithms. While StarCraft II-related environments have driven significant advances in MARL, existing benchmarks like SMAC focus primarily on micromanagement, limiting comprehensive evaluation of high-level strategic intelligence. To address this, we introduce HLSMAC, a new cooperative MARL benchmark with 12 carefully designed StarCraft II scenarios based on classical stratagems from the Thirty-Six Stratagems. Each scenario corresponds to a specific stratagem and is designed to challenge agents with diverse strategic elements, including tactical maneuvering, timing coordination, and deception, thereby opening up avenues for evaluating high-level strategic decision-making capabilities. We also propose novel metrics across multiple dimensions beyond conventional win rate, such as ability utilization and advancement efficiency, to assess agents' overall performance within the HLSMAC environment. We integrate state-of-the-art MARL algorithms and LLM-based agents with our benchmark and conduct comprehensive experiments. The results demonstrate that HLSMAC serves as a robust testbed for advancing multi-agent strategic decision-making.

📄 PDF Abstract BibTeX arXiv:2509.12927

Code (0)

등록된 구현이 없습니다.

Tasks

Multi-agent Reinforcement Learning Starcraft II

The StarCraft Multi-Agent Challenge

2019-02-11 · Mikayel Samvelyan, Tabish Rashid, Christian Schroeder de Witt, Gregory Farquhar 외

In the last few years, deep multi-agent reinforcement learning (RL) has become a highly active area of research. A particularly challenging class of problems in this area is partially observable, cooperative, multi-agent…

Benchmarking MuJoCo Multi-agent Reinforcement Learning Real-Time Strategy Games+6

SMAClite: A Lightweight Environment for Multi-Agent Reinforcement Learning

2023-05-09 · Adam Michalski, Filippos Christianos, Stefano V. Albrecht

There is a lack of standard benchmarks for Multi-Agent Reinforcement Learning (MARL) algorithms. The Starcraft Multi-Agent Challenge (SMAC) has been widely used in MARL research, but is built on top of a heavy, closed-so…

Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)+4

StarCraft II: A New Challenge for Reinforcement Learning

2017-08-16 · Oriol Vinyals, Timo Ewalds, Sergey Bartunov, Petko Georgiev 외

This paper introduces SC2LE (StarCraft II Learning Environment), a reinforcement learning environment based on the StarCraft II game. This domain poses a new grand challenge for reinforcement learning, representing a mor…

Deep Reinforcement Learning Real-Time Strategy Games reinforcement-learning Reinforcement Learning+3

Large Language Models Play StarCraft II: Benchmarks and A Chain of Summarization Approach

2023-12-19 · Weiyu Ma, Qirui Mi, Yongcheng Zeng, Xue Yan 외

StarCraft II is a challenging benchmark for AI agents due to the necessity of both precise micro level operations and strategic macro awareness. Previous works, such as Alphastar and SCC, achieve impressive performance o…

Language Modelling Large Language Model Starcraft Starcraft II

LLM-PySC2: Starcraft II learning environment for Large Language Models

2024-11-08 · Zongyuan Li, Yanan Ni, Runnan Qi, Lumin Jiang 외

This paper introduces a new environment LLM-PySC2 (the Large Language Model StarCraft II Learning Environment), a platform derived from DeepMind's StarCraft II Learning Environment that serves to develop Large Language M…

Decision Making Language Modelling Large Language Model SMAC+3