VScript: Controllable Script Generation with Visual Presentation
In order to offer a customized script tool and inspire professional scriptwriters, we present VScript. It is a controllable pipeline that generates complete scripts, including dialogues and scene descriptions, as well as presents visually using video retrieval. With an interactive interface, our system allows users to select genres and input starting words that control the theme and development of the generated script. We adopt a hierarchical structure, which first generates the plot, then the script and its visual presentation. A novel approach is also introduced to plot-guided dialogue generation by treating it as an inverse dialogue summarization. The experiment results show that our approach outperforms the baselines on both automatic and human evaluations, especially in genre control.
Code (0)
등록된 구현이 없습니다.
Tasks
Dialogue GenerationRetrievalScript GenerationVideo RetrievalSimilar Papers 제목 키워드 기반
CTRL-O: Language-Controllable Object-Centric Visual Representation Learning
Object-centric representation learning aims to decompose visual scenes into fixed-size vectors called "slots" or "object files", where each slot captures a distinct object. Current state-of-the-art object-centric models …
Image GenerationObjectObject DiscoveryQuestion Answering+4InstanceControl: Controllable Complex Image Generation without Instance Labeling
Controllable image generation methods, such as ControlNet, have demonstrated a remarkable capacity to introduce visual conditions(e.g., depth maps) to guide image generation. However, these methods often struggle with co…
Image GenerationRoomPilot: Controllable Indoor Scene Synthesis via Multimodal Semantic Parsing
Generating controllable indoor scenes is fundamental to applications in game development, architectural visualization, and embodied AI. However, existing approaches either support a limited input modalities or rely on im…
Indoor Scene SynthesisScene GenerationSemantic Parsing4DSynth: Controllable Procedural World Synthesis for Dynamic Embodied Simulation
Embodied agents need environments that are visually diverse, physically interactive, and changing over time. Procedural simulators can generate large interactive scene collections, and recent 4D generators produce compel…
XFBoost: Improving Text Generation with Controllable Decoders
Multimodal conditionality in transformer-based natural language models has demonstrated state-of-the-art performance in the task of product description generation. Recent approaches condition a language model on one or m…
DescriptiveLanguage ModelingLanguage ModellingText Generation