paper-with-me

홈 › Papers

What Makes the Story Forward? Inferring Commonsense Explanations as Prompts for Future Event Generation

2022-01-18 · Li Lin, Yixin Cao, Lifu Huang, Shu'ang Li, Xuming Hu, Lijie Wen, Jianmin Wang

Prediction over event sequences is critical for many real-world applications in Information Retrieval and Natural Language Processing. Future Event Generation (FEG) is a challenging task in event sequence prediction because it requires not only fluent text generation but also commonsense reasoning to maintain the logical coherence of the entire event story. In this paper, we propose a novel explainable FEG framework, Coep. It highlights and integrates two types of event knowledge, sequential knowledge of direct event-event relations and inferential knowledge that reflects the intermediate character psychology between events, such as intents, causes, reactions, which intrinsically pushes the story forward. To alleviate the knowledge forgetting issue, we design two modules, Im and Gm, for each type of knowledge, which are combined via prompt tuning. First, Im focuses on understanding inferential knowledge to generate commonsense explanations and provide a soft prompt vector for Gm. We also design a contrastive discriminator for better generalization ability. Second, Gm generates future events by modeling direct sequential knowledge with the guidance of Im. Automatic and human evaluation demonstrate that our approach can generate more coherent, specific, and logical future events.

📄 PDF Abstract BibTeX arXiv:2201.07099

Code (0)

등록된 구현이 없습니다.

Tasks

Information RetrievalRetrievalText Generation

Similar Papers 제목 키워드 기반

What Makes The Story Forward? Inferring Commonsense Explanations as Prompts for Future Event Generation

2021-11-16 · ACL ARR November 2021 11 · Anonymous

Future Event Generation (FEG) aims to generate fluent and reasonable future event descriptions given preceding events. It requires not only fluent text generation but also commonsense reasoning to maintain the coherence …

Text Generation

Inferring the Reader: Guiding Automated Story Generation with Commonsense Reasoning

2021-05-04 · Xiangyu Peng, Siyan Li, Sarah Wiegreffe, Mark Riedl

Transformer-based language model approaches to automated story generation currently provide state-of-the-art results. However, they still suffer from plot incoherence when generating narratives over time, and critically …

Language ModelingLanguage ModellingStory Generation

Can Language Models Take A Hint? Prompting for Controllable Contextualized Commonsense Inference

2021-10-16 · ACL ARR October 2021 10 · Anonymous

Generating commonsense assertions, given a certain story context, is a tough challenge even for modern language models. One of the reasons for this may be that the model has to "guess" what topic or entity in a story to …

Data AugmentationText Generation

Adversarial Transformer Language Models for Contextual Commonsense Inference

2023-02-10 · Pedro Colon-Hernandez, Henry Lieberman, Yida Xin, Claire Yin 외

Contextualized or discourse aware commonsense inference is the task of generating coherent commonsense assertions (i.e., facts) from a given story, and a particular sentence from that story. Some problems with the task a…

Knowledge GraphsLanguage ModelingLanguage ModellingSentence

Story Comprehension for Predicting What Happens Next

2017-09-01 · EMNLP 2017 9 · Snigdha Chaturvedi, Haoruo Peng, Dan Roth

Automatic story comprehension is a fundamental challenge in Natural Language Understanding, and can enable computers to learn about social norms, human behavior and commonsense. In this paper, we present a story comprehe…

Common Sense ReasoningNatural Language UnderstandingQuestion AnsweringReading Comprehension+2