paper-with-me

Papers

Event Representation Learning Enhanced with External Commonsense Knowledge

2019-09-09 · IJCNLP 2019 11 · Xiao Ding, Kuo Liao, Ting Liu, Zhongyang Li, Junwen Duan

Prior work has proposed effective methods to learn event representations that can capture syntactic and semantic information over text corpus, demonstrating their effectiveness for downstream tasks such as script event prediction. On the other hand, events extracted from raw texts lacks of commonsense knowledge, such as the intents and emotions of the event participants, which are useful for distinguishing event pairs when there are only subtle differences in their surface realizations. To address this issue, this paper proposes to leverage external commonsense knowledge about the intent and sentiment of the event. Experiments on three event-related tasks, i.e., event similarity, script event prediction and stock market prediction, show that our model obtains much better event embeddings for the tasks, achieving 78% improvements on hard similarity task, yielding more precise inferences on subsequent events under given contexts, and better accuracies in predicting the volatilities of the stock market.

📄 PDF Abstract BibTeX arXiv:1909.05190

Code (1)

MagiaSN/CommonsenseERL_EMNLP_2019 공식 구현 pytorch

Tasks

PredictionRepresentation LearningStock Market Prediction

Similar Papers 제목 키워드 기반

ExBERT: An External Knowledge Enhanced BERT for Natural Language Inference

2021-08-03 · Amit Gajbhiye, Noura Al Moubayed, Steven Bradley

Neural language representation models such as BERT, pre-trained on large-scale unstructured corpora lack explicit grounding to real-world commonsense knowledge and are often unable to remember facts required for reasonin…

Knowledge GraphsNatural Language Inference

A Knowledge-Enhanced Pretraining Model for Commonsense Story Generation

2020-01-15 · TACL 2020 1 · Jian Guan, Fei Huang, Zhihao Zhao, Xiaoyan Zhu 외

Story generation, namely generating a reasonable story from a leading context, is an important but challenging task. In spite of the success in modeling fluency and local coherence, existing neural language generation mo…

Multi-Task LearningStory GenerationText Generation

CoCoLM: COmplex COmmonsense Enhanced Language Model with Discourse Relations

2020-12-31 · Findings (ACL) 2022 5 · Changlong Yu, Hongming Zhang, Yangqiu Song, Wilfred Ng

Large-scale pre-trained language models have demonstrated strong knowledge representation ability. However, recent studies suggest that even though these giant models contains rich simple commonsense knowledge (e.g., bir…

Knowledge GraphsLanguage ModelingLanguage Modelling

CN-HIT-IT.NLP at SemEval-2020 Task 4: Enhanced Language Representation with Multiple Knowledge Triples

2020-12-01 · SEMEVAL 2020 · Yice Zhang, Jiaxuan Lin, Yang Fan, Peng Jin 외

This paper describes our system that participated in the SemEval-2020 task 4: Commonsense Validation and Explanation. For this task, it is obvious that external knowledge, such as Knowledge graph, can help the model unde…

Knowledge Graphs

KVL-BERT: Knowledge Enhanced Visual-and-Linguistic BERT for Visual Commonsense Reasoning

2020-12-13 · Dandan song, Siyi Ma, Zhanchen Sun, Sicheng Yang 외

Reasoning is a critical ability towards complete visual understanding. To develop machine with cognition-level visual understanding and reasoning abilities, the visual commonsense reasoning (VCR) task has been introduced…

SentenceVisual Commonsense ReasoningVisual Question Answering (VQA)