paper-with-me

홈 › Papers

Orchestrated Reality: From Role-Play to Living, Playable Game Worlds -- LLM-Driven World Simulation as a Parameterized-Action POMDP

2026-06-14 · Yuhang Huang, Chenmiao Li, Chaowei Fang arxiv

Many games rely on storytelling combined with systems that track levelling, NPC behaviour, and consequence simulation; bridging tightly-authored narrative with deeply-simulated worlds -- most acute in sandbox and open-world settings -- has been prohibitively expensive. LLM-driven worlds open a new path: a single harness can coordinate numerical state, narrative voice, storytelling pacing, and rule logic together. Realising this requires the LLM system to sustain a persistent world (who is where, what has just happened, what is currently true), which today's deployed systems do not: the narrative voice asserts state in free prose without any validated representation, so a fully autonomous game engine remains infeasible. We treat this as an architectural choice, not a limitation of language models, and report work in progress on a framework -- orchestrated reality -- that makes the world a canonical object owned by a singleton orchestration agent analogous to the tabletop-RPG Game Master (GM). We formalise an LLM-driven game world for a human player as a Parameterized-Action POMDP: state is a tree of canonical JSON entities, actions decompose as $a=(k, x_k)$ (a discrete intent kind plus structured JSON parameters), the agent observes only a narrative projection $o=O(s)$ of state, and the transition kernel $F$ is an LLM-driven Plan-Diff-Validate-Apply (PDVA) pipeline that commits schema-validated, content-hashed JSON deltas. We give the formal model, a JSON-state example, a worked single-turn example, and a catalogue of 15 illustrative incidents drawn from a real deployment showing the framework in action. Empirical validation through a planned human player study -- together with multi-NPC concurrent agency and deployment as an RL environment -- is situated as future work.

📄 PDF Abstract BibTeX arXiv:2606.16014

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Playable Game Generation

2024-12-01 · Mingyu Yang, Junyou Li, Zhongbin Fang, Sheng Chen 외

In recent years, Artificial Intelligence Generated Content (AIGC) has advanced from text-to-image generation to text-to-video and multimodal video synthesis. However, generating playable games presents significant challe…

GPUImage GenerationText to Image GenerationText-to-Image Generation

Playable Environments: Video Manipulation in Space and Time

2022-03-03 · CVPR 2022 1 · Willi Menapace, Stéphane Lathuilière, Aliaksandr Siarohin, Christian Theobalt 외

We present Playable Environments - a new representation for interactive video generation and manipulation in space and time. With a single image at inference time, our novel framework allows the user to move objects in 3…

Video Generation

Grounding Machine Creativity in Game Design Knowledge Representations: Empirical Probing of LLM-Based Executable Synthesis of Goal Playable Patterns under Structural Constraints

2026-03-07 · Hugh Xuechen Liu, Kıvanç Tatar arxiv

Creatively translating complex gameplay ideas into executable artifacts (e.g., games as Unity projects and code) remains a central challenge in computational game creativity. Gameplay design patterns provide a structured…

Goals are Enough: Inducing AdHoc cooperation among unseen Multi-Agent systems in IMFs

2023-10-26 · Kaushik Dey, Satheesh K. Perepu, Abir Das

Intent-based management will play a critical role in achieving customers' expectations in the next-generation mobile networks. Traditional methods cannot perform efficient resource management since they tend to handle ea…

ManagementMulti-agent Reinforcement Learning

Neural Wavetable: a playable wavetable synthesizer using neural networks

2018-11-13 · Lamtharn Hantrakul, Li-Chia Yang

We present Neural Wavetable, a proof-of-concept wavetable synthesizer that uses neural networks to generate playable wavetables. The system can produce new, distinct waveforms through the interpolation of traditional wav…