paper-with-me

홈 › Papers

From Prompts to Worlds: How Users Iterate, Explore, and Make Sense of AI-Generated 3D Environments

2026-01-24 · Aung Pyae arxiv

Text-to-3D generative AI systems create navigable environments from natural language prompts, but unlike text-to-image generation, evaluation requires embodied exploration of spatial coherence, scale, and navigability. We present the first empirical study of a commercial text-to-3D platform, combining think-aloud protocols, behavioral observation, and validated measures of usability, presence, and engagement. We report three findings. First, asymmetric expressibility: users readily convey semantic intent (themes, atmosphere) but struggle to specify spatial structure (layout, scale), reflecting a language-to-space limitation rather than a skill deficit. Second, episodic presence: immersion arises when expectations align with outputs but does not accumulate into sustained place illusion. Third, structural iteration breakdowns: refinement fails due to interaction barriers - poor discoverability, opaque feedback, and high temporal costs - rather than user limitations. Together, these dynamics form a reinforcing cycle in which spatial mismatches persist, producing episodic presence and ongoing sensemaking. We reframe text-to-3D interaction as negotiated meaning-making rather than linear prompting, and argue that effective systems require hybrid input modalities, transparent feedback, and low-cost iteration.

📄 PDF Abstract BibTeX arXiv:2603.13233

Code (0)

등록된 구현이 없습니다.

Tasks

Text-to-Image Generation

Similar Papers 제목 키워드 기반

Exploring Prompt Engineering Practices in the Enterprise

2024-03-13 · Michael Desmond, Michelle Brachman

Interaction with Large Language Models (LLMs) is primarily carried out via prompting. A prompt is a natural language instruction designed to elicit certain behaviour or output from a model. In theory, natural language pr…

Prompt Engineering

PromptSource: An Integrated Development Environment and Repository for Natural Language Prompts

2022-02-02 · ACL 2022 5 · Stephen H. Bach, Victor Sanh, Zheng-Xin Yong, Albert Webson 외

PromptSource is a system for creating, sharing, and using natural language prompts. Prompts are functions that map an example from a dataset to a natural language input and target output. Using prompts to train and query…

BISCUIT: Scaffolding LLM-Generated Code with Ephemeral UIs in Computational Notebooks

2024-04-10 · Ruijia Cheng, Titus Barik, Alan Leung, Fred Hohman 외

Programmers frequently engage with machine learning tutorials in computational notebooks and have been adopting code generation technologies based on large language models (LLMs). However, they encounter difficulties in …

Code GenerationPrompt Engineering

DeepMind Lab

2016-12-12 · Charles Beattie, Joel Z. Leibo, Denis Teplyashin, Tom Ward 외

DeepMind Lab is a first-person 3D game platform designed for research and development of general artificial intelligence and machine learning systems. DeepMind Lab can be used to study how autonomous artificial agents ma…

BIG-bench Machine Learning

Shaping Realities: Enhancing 3D Generative AI with Fabrication Constraints

2024-04-15 · Faraz Faruqi, Yingtao Tian, Vrushank Phadnis, Varun Jampani 외

Generative AI tools are becoming more prevalent in 3D modeling, enabling users to manipulate or create new models with text or images as inputs. This makes it easier for users to rapidly customize and iterate on their 3D…

3D geometry