Character-Centric Storytelling
Sequential vision-to-language or visual storytelling has recently been one of the areas of focus in computer vision and language modeling domains. Though existing models generate narratives that read subjectively well, there could be cases when these models miss out on generating stories that account and address all prospective human and animal characters in the image sequences. Considering this scenario, we propose a model that implicitly learns relationships between provided characters and thereby generates stories with respective characters in scope. We use the VIST dataset for this purpose and report numerous statistics on the dataset. Eventually, we describe the model, explain the experiment and discuss our current status and future work.
Code (0)
등록된 구현이 없습니다.
Tasks
Language ModelingLanguage ModellingVisual StorytellingSimilar Papers 제목 키워드 기반
Inferring the Reader: Guiding Automated Story Generation with Commonsense Reasoning
Transformer-based language model approaches to automated story generation currently provide state-of-the-art results. However, they still suffer from plot incoherence when generating narratives over time, and critically …
Language ModelingLanguage ModellingStory GenerationWhere Do People Tell Stories Online? Story Detection Across Online Communities
Story detection in online communities is a challenging task as stories are scattered across communities and interwoven with non-storytelling spans within a single text. We address this challenge by building and releasing…
Persuasion StrategiesDetecting and Grounding Important Characters in Visual Stories
Characters are essential to the plot of any story. Establishing the characters before writing a story can improve the clarity of the plot and the overall flow of the narrative. However, previous work on visual storytelli…
Visual StorytellingComprehending Spatio-temporal Data via Cinematic Storytelling using Large Language Models
Spatio-temporal data captures complex dynamics across both space and time, yet traditional visualizations are complex, require domain expertise and often fail to resonate with broader audiences. Here, we propose MapMuse,…
Egocentric Video Description based on Temporally-Linked Sequences
Egocentric vision consists in acquiring images along the day from a first person point-of-view using wearable cameras. The automatic analysis of this information allows to discover daily patterns for improving the qualit…
DecoderVideo Description