paper-with-me

Papers

Plot and Rework: Modeling Storylines for Visual Storytelling

2021-05-14 · Findings (ACL) 2021 8 · Chi-Yang Hsu, Yun-Wei Chu, Ting-Hao 'Kenneth' Huang, Lun-Wei Ku

Writing a coherent and engaging story is not easy. Creative writers use their knowledge and worldview to put disjointed elements together to form a coherent storyline, and work and rework iteratively toward perfection. Automated visual storytelling (VIST) models, however, make poor use of external knowledge and iterative generation when attempting to create stories. This paper introduces PR-VIST, a framework that represents the input image sequence as a story graph in which it finds the best path to form a storyline. PR-VIST then takes this path and learns to generate the final story via an iterative training process. This framework produces stories that are superior in terms of diversity, coherence, and humanness, per both automatic and human evaluations. An ablation study shows that both plotting and reworking contribute to the model's superiority.

📄 PDF Abstract BibTeX arXiv:2105.06950

Code (1)

ethan5437/PR-VIST pytorch

Tasks

DiversityFormVisual Storytelling

Similar Papers 제목 키워드 기반

"Kurosawa": A Script Writer's Assistant

2023-08-06 · Prerak Gandhi, Vishal Pramanik, Pushpak Bhattacharyya

Storytelling is the lifeline of the entertainment industry -- movies, TV shows, and stand-up comedies, all need stories. A good and gripping script is the lifeline of storytelling and demands creativity and resource inve…

Script Generation

Storytelling of Photo Stream with Bidirectional Multi-thread Recurrent Neural Network

2016-06-02 · Yu Liu, Jianlong Fu, Tao Mei, Chang Wen Chen

Visual storytelling aims to generate human-level narrative language (i.e., a natural paragraph with multiple sentences) from a photo streams. A typical photo story consists of a global timeline with multi-thread local st…

Video CaptioningVisual Storytelling

PlotThread: Creating Expressive Storyline Visualizations using Reinforcement Learning

2020-09-01 · Tan Tang, Renzhong Li, Xinke Wu, Shuhan Liu 외

Storyline visualizations are an effective means to present the evolution of plots and reveal the scenic interactions among characters. However, the design of storyline visualizations is a difficult task as users need to …

AI AgentEfficient Explorationreinforcement-learningReinforcement Learning+1

Let Storytelling Tell Vivid Stories: An Expressive and Fluent Multimodal Storyteller

2024-03-12 · Chuanqi Zang, Jiji Tang, Rongsheng Zhang, Zeng Zhao 외

Storytelling aims to generate reasonable and vivid narratives based on an ordered image stream. The fidelity to the image story theme and the divergence of story plots attract readers to keep reading. Previous works iter…

Story Generation

Narrative Smoothing: Dynamic Conversational Network for the Analysis of TV Series Plots

2016-02-25 · Xavier Bost, Vincent Labatut, Serigne Gueye, Georges Linarès

Modern popular TV series often develop complex storylines spanning several seasons, but are usually watched in quite a discontinuous way. As a result, the viewer generally needs a comprehensive summary of the previous se…