MUSE: A Multi-agent Framework for Unconstrained Story Envisioning via Closed-Loop Cognitive Orchestration
Generating long-form audio-visual stories from a short user prompt remains challenging due to an intent-execution gap, where high-level narrative intent must be preserved across coherent, shot-level multimodal generation over long horizons. Existing approaches typically rely on feed-forward pipelines or prompt-only refinement, which often leads to semantic drift and identity inconsistency as sequences grow longer. We address this challenge by formulating storytelling as a closed-loop constraint enforcement problem and propose MUSE, a multi-agent framework that coordinates generation through an iterative plan-execute-verify-revise loop. MUSE translates narrative intent into explicit, machine-executable controls over identity, spatial composition, and temporal continuity, and applies targeted multimodal feedback to correct violations during generation. To evaluate open-ended storytelling without ground-truth references, we introduce MUSEBench, a reference-free evaluation protocol validated by human judgments. Experiments demonstrate that MUSE substantially improves long-horizon narrative coherence, cross-modal identity consistency, and cinematic quality compared with representative baselines.
Code (0)
등록된 구현이 없습니다.
Tasks
multimodal generationSimilar Papers 제목 키워드 기반
Conversational AI-Enhanced Exploration System to Query Large-Scale Digitised Collections of Natural History Museums
Recent digitisation efforts in natural history museums have produced large volumes of collection data, yet their scale and scientific complexity often hinder public access and understanding. Conventional data management …
MUSE: A Theory-Harnessed Story Engine for Vibe Narrativizing
LLMs can generate fluent prose. Turning this capability into high-quality stories requires coordinating decisions about plot, character, and language across planning, drafting, and revision. Guiding these decisions prese…
MUSE: An Interactive Meta-Agent for Understanding and Steering LLM-powered Data Science Systems
Recent advances in large language models have enabled a new class of agentic data science systems that allow users to complete complex data science workflows through natural language. Although these systems can significa…
Comprehending Spatio-temporal Data via Cinematic Storytelling using Large Language Models
Spatio-temporal data captures complex dynamics across both space and time, yet traditional visualizations are complex, require domain expertise and often fail to resonate with broader audiences. Here, we propose MapMuse,…
Story2Proposal: A Scaffold for Structured Scientific Paper Writing
Generating scientific manuscripts requires maintaining alignment between narrative reasoning, experimental evidence, and visual artifacts across the document lifecycle. Existing language-model generation pipelines rely o…