IDN-Sum: A New Dataset for Interactive Digital Narrative Extractive Text Summarisation
Summarizing Interactive Digital Narratives (IDN) presents some unique challenges to existing text summarization models especially around capturing interactive elements in addition to important plot points. In this paper, we describe the first IDN dataset (IDN-Sum) designed specifically for training and testing IDN text summarization algorithms. Our dataset is generated using random playthroughs of 8 IDN episodes, taken from 2 different IDN games, and consists of 10,000 documents. Playthrough documents are annotated through automatic alignment with fan-sourced summaries using a commonly used alignment algorithm. We also report and discuss results from experiments applying common baseline extractive text summarization algorithms to this dataset. Qualitative analysis of the results reveals shortcomings in common annotation approaches and evaluation methods when applied to narrative and interactive narrative datasets. The dataset is released as open source for future researchers to train and test their own approaches for IDN text.
Code (1)
Tasks
Extractive Text SummarizationText SummarizationSimilar Papers 제목 키워드 기반
SNAP: A Plan-Driven Framework for Controllable Interactive Narrative Generation
Large Language Models (LLMs) hold great potential for web-based interactive applications, including browser games, online education, and digital storytelling platforms. However, LLM-based conversational agents suffer fro…
From Words to Worlds: Transforming One-line Prompt into Immersive Multi-modal Digital Stories with Communicative LLM Agent
Digital storytelling, essential in entertainment, education, and marketing, faces challenges in production scalability and flexibility. The StoryAgent framework, introduced in this paper, utilizes Large Language Models a…
MarketingExtractive NarrativeQA with Heuristic Pre-Training
Although advances in neural architectures for NLP problems as well as unsupervised pre-training have led to substantial improvements on question answering and natural language inference, understanding of and reasoning ov…
Natural Language InferencePassage RetrievalQuestion AnsweringRetrieval+1Lay Text Summarisation Using Natural Language Processing: A Narrative Literature Review
Summarisation of research results in plain language is crucial for promoting public understanding of research findings. The use of Natural Language Processing to generate lay summaries has the potential to relieve resear…
Abstractive Text SummarizationArticlesScreenplay Summarization Using Latent Narrative Structure
Most general-purpose extractive summarization models are trained on news articles, which are short and present all important information upfront. As a result, such models are biased on position and often perform a smart …
ArticlesDocument SummarizationExtractive SummarizationExtractive Text Summarization+3