paper-with-me

Papers

Towards a Holodeck-style Simulation Game

2023-08-22 · Ahad Shams, Douglas Summers-Stay, Arpan Tripathi, Vsevolod Metelsky, Alexandros Titonis, Karan Malhotra

We introduce Infinitia, a simulation game system that uses generative image and language models at play time to reshape all aspects of the setting and NPCs based on a short description from the player, in a way similar to how settings are created on the fictional Holodeck. Building off the ideas of the Generative Agents paper, our system introduces gameplay elements, such as infinite generated fantasy worlds, controllability of NPC behavior, humorous dialogue, cost & time efficiency, collaboration between players and elements of non-determinism among in-game events. Infinitia is implemented in the Unity engine with a server-client architecture, facilitating the addition of exciting features by community developers in the future. Furthermore, it uses a multiplayer framework to allow humans to be present and interact in the simulation. The simulation will be available in open-alpha shortly at https://infinitia.ai/ and we are looking forward to building upon it with the community.

📄 PDF Abstract BibTeX arXiv:2308.13548

Code (0)

등록된 구현이 없습니다.

Tasks

Unity

Similar Papers 제목 키워드 기반

HOLODECK 2.0: Vision-Language-Guided 3D World Generation with Editing

2025-08-07 · Zixuan Bian, Ruohan Ren, Yue Yang, Chris Callison-Burch arxiv

3D scene generation plays a crucial role in gaming, artistic creation, virtual reality, and many other domains. However, current 3D scene design still relies heavily on extensive manual effort from creators, and existing…

Scene Generation

Holodeck: Language Guided Generation of 3D Embodied AI Environments

2023-12-14 · CVPR 2024 1 · Yue Yang, Fan-Yun Sun, Luca Weihs, Eli VanderBilt 외

3D simulated environments play a critical role in Embodied AI, but their creation requires expertise and extensive manual effort, restricting their diversity and scope. To mitigate this limitation, we present Holodeck, a…

Common Sense ReasoningLanguage ModellingLarge Language ModelNavigate

People use fast, goal-directed simulation to reason about novel games

2024-07-19 · Cedegao E. Zhang, Katherine M. Collins, Lionel Wong, Mauricio Barba 외

People can evaluate features of problems and their potential solutions well before we can effectively solve them. When considering a game we have never played, for instance, we might infer whether it is likely to be chal…

Board Games

MAGIC: Transition-Aware Generation of Navigable Multi-Scene Game Worlds with Large Language Models

2026-07-13 · Tsz Hei Fan, Choi Wing Fung, Yuxuan Wan, Shuqing Li 외 hf

Multi-scene navigation (clearing an objective in one bounded space and then crossing a portal into the next) is a defining feature of contemporary 3D games, but authoring it is laborious: every portal must have consisten…

An Unsupervised Video Game Playstyle Metric via State Discretization

2021-10-03 · Chiu-Chou Lin, Wei-Chen Chiu, I-Chen Wu

On playing video games, different players usually have their own playstyles. Recently, there have been great improvements for the video game AIs on the playing strength. However, past researches for analyzing the behavio…

Atari GamesCar RacingDecision Making