paper-with-me

Papers

StarCraftImage: A Dataset For Prototyping Spatial Reasoning Methods For Multi-Agent Environments

2024-01-09 · CVPR 2023 1 · Sean Kulinski, Nicholas R. Waytowich, James Z. Hare, David I. Inouye

Spatial reasoning tasks in multi-agent environments such as event prediction, agent type identification, or missing data imputation are important for multiple applications (e.g., autonomous surveillance over sensor networks and subtasks for reinforcement learning (RL)). StarCraft II game replays encode intelligent (and adversarial) multi-agent behavior and could provide a testbed for these tasks; however, extracting simple and standardized representations for prototyping these tasks is laborious and hinders reproducibility. In contrast, MNIST and CIFAR10, despite their extreme simplicity, have enabled rapid prototyping and reproducibility of ML methods. Following the simplicity of these datasets, we construct a benchmark spatial reasoning dataset based on StarCraft II replays that exhibit complex multi-agent behaviors, while still being as easy to use as MNIST and CIFAR10. Specifically, we carefully summarize a window of 255 consecutive game states to create 3.6 million summary images from 60,000 replays, including all relevant metadata such as game outcome and player races. We develop three formats of decreasing complexity: Hyperspectral images that include one channel for every unit type (similar to multispectral geospatial images), RGB images that mimic CIFAR10, and grayscale images that mimic MNIST. We show how this dataset can be used for prototyping spatial reasoning methods. All datasets, code for extraction, and code for dataset loading can be found at https://starcraftdata.davidinouye.com

📄 PDF Abstract BibTeX arXiv:2401.04290

Code (0)

등록된 구현이 없습니다.

Tasks

ImputationReinforcement Learning (RL)Spatial ReasoningStarcraftStarcraft II

Similar Papers 제목 키워드 기반

A ROS multi-ontology references services: OWL reasoners and application prototyping issues

2017-06-30 · Luca Buoncompagni, Alessio Capitanelli, Fulvio Mastrogiovanni

This paper introduces a ROS Multi Ontology References (ARMOR) service, a general-purpose and scalable interface between robot architectures and OWL reasoners. ARMOR addresses synchronisation and communication issues amon…

Discovery Learning accelerates battery design evaluation

2025-08-09 · Jiawei Zhang, Yifei Zhang, Baozhao Yi, Yao Ren 외 arxiv

Fast and reliable validation of novel designs in complex physical systems such as batteries is critical to accelerating technological innovation. However, battery research and development remain bottlenecked by the prohi…

Zero-Shot LearningActive Learning

Human-Centered AI Product Prototyping with No-Code AutoML: Conceptual Framework, Potentials and Limitations

2024-02-06 · Mario Truss, Marc Schmitt

This paper addresses the complexities inherent in AI product prototyping, focusing on the challenges posed by the probabilistic nature of AI behavior and the limited accessibility of prototyping tools to non-experts. A D…

AutoMLDecision Making

Conversational AI for Rapid Scientific Prototyping: A Case Study on ESA's ELOPE Competition

2026-01-08 · Nils Einecke arxiv

Large language models (LLMs) are increasingly used as coding partners, yet their role in accelerating scientific discovery remains underexplored. This paper presents a case study of using ChatGPT for rapid prototyping in…

PromptInfuser: How Tightly Coupling AI and UI Design Impacts Designers' Workflows

2023-10-24 · Savvas Petridis, Michael Terry, Carrie J. Cai

Prototyping AI applications is notoriously difficult. While large language model (LLM) prompting has dramatically lowered the barriers to AI prototyping, designers are still prototyping AI functionality and UI separately…

Language ModelingLanguage ModellingLarge Language Model