Augmented Neural Story Generation with Commonsense Inference
Transformer-based language model approaches to automated story generation currently provide state-of-the-art results. However, they still suffer from plot incoherence when generating narratives over time, and critically lack basic commonsense reasoning. Furthermore, existing methods generally focus only on single-character stories, or fail to track characters at all. To improve the coherence of generated narratives and to expand the scope of character-centric narrative generation, we introduce Commonsense-inference Augmented neural StoryTelling (CAST), a framework for introducing commonsense reasoning into the generation process while modeling the interaction between multiple characters. We find that our CAST method produces significantly more coherent and on-topic two-character stories, outperforming baselines in dimensions including plot plausibility and staying on topic. We also show how the CAST method can be used to further train language models that generate more coherent stories and reduce computation cost.
Code (0)
등록된 구현이 없습니다.
Tasks
Language ModelingLanguage ModellingStory GenerationSimilar Papers 제목 키워드 기반
Inferring the Reader: Guiding Automated Story Generation with Commonsense Reasoning
Transformer-based language model approaches to automated story generation currently provide state-of-the-art results. However, they still suffer from plot incoherence when generating narratives over time, and critically …
Language ModelingLanguage ModellingStory Generation$\rm{C {\small IS}}^2$: A Simplified Commonsense Inference Evaluation for Story Prose
Transformers have been showing near-human performance on a variety of tasks, but they are not without their limitations. We discuss the issue of conflating results of transformers that are instructed to do multiple tasks…
SentenceText GenerationLeveraging Explicit Reasoning for Inference Integration in Commonsense-Augmented Dialogue Models
Open-domain dialogue systems need to grasp social commonsense to understand and respond effectively to human users. Commonsense-augmented dialogue models have been proposed that aim to infer commonsense knowledge from di…
Response GenerationSpecificityCan Language Models Take A Hint? Prompting for Controllable Contextualized Commonsense Inference
Generating commonsense assertions, given a certain story context, is a tough challenge even for modern language models. One of the reasons for this may be that the model has to "guess" what topic or entity in a story to …
Data AugmentationText GenerationCan Language Models Take A Hint? Prompting for Controllable Contextualized Commonsense Inference
Generating commonsense assertions within a given story context remains a difficult task for modern language models. Previous research has addressed this problem by aligning commonsense inferences with stories and trainin…
Data AugmentationText Generation