Plot and Rework: Modeling Storylines for Visual Storytelling
Writing a coherent and engaging story is not easy. Creative writers use their knowledge and worldview to put disjointed elements together to form a coherent storyline, and work and rework iteratively toward perfection. Automated visual storytelling (VIST) models, however, make poor use of external knowledge and iterative generation when attempting to create stories. This paper introduces PR-VIST, a framework that represents the input image sequence as a story graph in which it finds the best path to form a storyline. PR-VIST then takes this path and learns to generate the final story via an iterative training process. This framework produces stories that are superior in terms of diversity, coherence, and humanness, per both automatic and human evaluations. An ablation study shows that both plotting and reworking contribute to the model's superiority.
Code (1)
Tasks
DiversityFormVisual StorytellingSimilar Papers 제목 키워드 기반
"Kurosawa": A Script Writer's Assistant
Storytelling is the lifeline of the entertainment industry -- movies, TV shows, and stand-up comedies, all need stories. A good and gripping script is the lifeline of storytelling and demands creativity and resource inve…
Script GenerationStorytelling of Photo Stream with Bidirectional Multi-thread Recurrent Neural Network
Visual storytelling aims to generate human-level narrative language (i.e., a natural paragraph with multiple sentences) from a photo streams. A typical photo story consists of a global timeline with multi-thread local st…
Video CaptioningVisual StorytellingPlotThread: Creating Expressive Storyline Visualizations using Reinforcement Learning
Storyline visualizations are an effective means to present the evolution of plots and reveal the scenic interactions among characters. However, the design of storyline visualizations is a difficult task as users need to …
AI AgentEfficient Explorationreinforcement-learningReinforcement Learning+1Let Storytelling Tell Vivid Stories: An Expressive and Fluent Multimodal Storyteller
Storytelling aims to generate reasonable and vivid narratives based on an ordered image stream. The fidelity to the image story theme and the divergence of story plots attract readers to keep reading. Previous works iter…
Story GenerationNarrative Smoothing: Dynamic Conversational Network for the Analysis of TV Series Plots
Modern popular TV series often develop complex storylines spanning several seasons, but are usually watched in quite a discontinuous way. As a result, the viewer generally needs a comprehensive summary of the previous se…