paper-with-me

Papers

SwarmBrain: Embodied agent for real-time strategy game StarCraft II via large language models

2024-01-31 · Xiao Shao, Weifu Jiang, Fei Zuo, Mengqing Liu

Large language models (LLMs) have recently garnered significant accomplishments in various exploratory tasks, even surpassing the performance of traditional reinforcement learning-based methods that have historically dominated the agent-based field. The purpose of this paper is to investigate the efficacy of LLMs in executing real-time strategy war tasks within the StarCraft II gaming environment. In this paper, we introduce SwarmBrain, an embodied agent leveraging LLM for real-time strategy implementation in the StarCraft II game environment. The SwarmBrain comprises two key components: 1) a Overmind Intelligence Matrix, powered by state-of-the-art LLMs, is designed to orchestrate macro-level strategies from a high-level perspective. This matrix emulates the overarching consciousness of the Zerg intelligence brain, synthesizing strategic foresight with the aim of allocating resources, directing expansion, and coordinating multi-pronged assaults. 2) a Swarm ReflexNet, which is agile counterpart to the calculated deliberation of the Overmind Intelligence Matrix. Due to the inherent latency in LLM reasoning, the Swarm ReflexNet employs a condition-response state machine framework, enabling expedited tactical responses for fundamental Zerg unit maneuvers. In the experimental setup, SwarmBrain is in control of the Zerg race in confrontation with an Computer-controlled Terran adversary. Experimental results show the capacity of SwarmBrain to conduct economic augmentation, territorial expansion, and tactical formulation, and it shows the SwarmBrain is capable of achieving victory against Computer players set at different difficulty levels.

📄 PDF Abstract BibTeX arXiv:2401.17749

Code (1)

ramsayxiaoshao/SwarmBrain-Embodied-agent-for-real-time-strategy-game-StarCraft-II-via-large-language-models 공식 구현

Tasks

StarcraftStarcraft II

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically

Similar Papers 제목 키워드 기반

CoEnv: Driving Embodied Multi-Agent Collaboration via Compositional Environment

2026-04-07 · Li Kang, Yutao Fan, Rui Li, Heng Zhou 외 arxiv

Multi-agent embodied systems hold promise for complex collaborative manipulation, yet face critical challenges in spatial coordination, temporal reasoning, and shared workspace awareness. Inspired by human collaboration …

Think Twice, Act Once: Verifier-Guided Action Selection For Embodied Agents

2026-05-12 · Nishad Singhi, Christian Bialas, Snehal Jauhri, Vignesh Prasad 외 arxiv

Building generalist embodied agents capable of solving complex real-world tasks remains a fundamental challenge in AI. Multimodal Large Language Models (MLLMs) have significantly advanced the reasoning capabilities of su…

Embodied Image Compression

2025-12-12 · Chunyi Li, Rui Qing, Jianbo Zhang, Yuan Tian 외 arxiv

Image Compression for Machines (ICM) has emerged as a pivotal research direction in the field of visual data compression. However, with the rapid evolution of machine intelligence, the target of compression has shifted f…

Image Compression

World-in-World: World Models in a Closed-Loop World

2025-10-20 · Jiahan Zhang, Muqing Jiang, Nanru Dai, Taiming Lu 외 arxiv

Generative world models (WMs) can now simulate worlds with striking visual realism, which naturally raises the question of whether they can endow embodied agents with predictive perception for decision making. Progress o…

Decision Making

DIRECT: When and Where Should You Allocate Test-Time Compute in Embodied Planners?

2026-06-10 · Jadelynn Dao, Milan Ganai, Yasmina Abukhadra, Ajay Sridhar 외 arxiv

Vision-Language Models (VLMs) are increasingly deployed as high-level planners for embodied agents, with an emerging strategy of scaling test-time compute to improve capability. However, we observe that doing so increase…