What Makes the Story Forward? Inferring Commonsense Explanations as Prompts for Future Event Generation
Prediction over event sequences is critical for many real-world applications in Information Retrieval and Natural Language Processing. Future Event Generation (FEG) is a challenging task in event sequence prediction because it requires not only fluent text generation but also commonsense reasoning to maintain the logical coherence of the entire event story. In this paper, we propose a novel explainable FEG framework, Coep. It highlights and integrates two types of event knowledge, sequential knowledge of direct event-event relations and inferential knowledge that reflects the intermediate character psychology between events, such as intents, causes, reactions, which intrinsically pushes the story forward. To alleviate the knowledge forgetting issue, we design two modules, Im and Gm, for each type of knowledge, which are combined via prompt tuning. First, Im focuses on understanding inferential knowledge to generate commonsense explanations and provide a soft prompt vector for Gm. We also design a contrastive discriminator for better generalization ability. Second, Gm generates future events by modeling direct sequential knowledge with the guidance of Im. Automatic and human evaluation demonstrate that our approach can generate more coherent, specific, and logical future events.
Code (0)
등록된 구현이 없습니다.
Tasks
Information RetrievalRetrievalText GenerationSimilar Papers 제목 키워드 기반
What Makes The Story Forward? Inferring Commonsense Explanations as Prompts for Future Event Generation
Future Event Generation (FEG) aims to generate fluent and reasonable future event descriptions given preceding events. It requires not only fluent text generation but also commonsense reasoning to maintain the coherence …
Text GenerationInferring the Reader: Guiding Automated Story Generation with Commonsense Reasoning
Transformer-based language model approaches to automated story generation currently provide state-of-the-art results. However, they still suffer from plot incoherence when generating narratives over time, and critically …
Language ModelingLanguage ModellingStory GenerationCan Language Models Take A Hint? Prompting for Controllable Contextualized Commonsense Inference
Generating commonsense assertions, given a certain story context, is a tough challenge even for modern language models. One of the reasons for this may be that the model has to "guess" what topic or entity in a story to …
Data AugmentationText GenerationAdversarial Transformer Language Models for Contextual Commonsense Inference
Contextualized or discourse aware commonsense inference is the task of generating coherent commonsense assertions (i.e., facts) from a given story, and a particular sentence from that story. Some problems with the task a…
Knowledge GraphsLanguage ModelingLanguage ModellingSentenceStory Comprehension for Predicting What Happens Next
Automatic story comprehension is a fundamental challenge in Natural Language Understanding, and can enable computers to learn about social norms, human behavior and commonsense. In this paper, we present a story comprehe…
Common Sense ReasoningNatural Language UnderstandingQuestion AnsweringReading Comprehension+2