Commonsense Inference in Natural Language Processing (COIN) - Shared Task Report
This paper reports on the results of the shared tasks of the COIN workshop at EMNLP-IJCNLP 2019. The tasks consisted of two machine comprehension evaluations, each of which tested a system{'}s ability to answer questions/queries about a text. Both evaluations were designed such that systems need to exploit commonsense knowledge, for example, in the form of inferences over information that is available in the common ground but not necessarily mentioned in the text. A total of five participating teams submitted systems for the shared tasks, with the best submitted system achieving 90.6{\%} accuracy and 83.7{\%} F1-score on task 1 and task 2, respectively.
Code (0)
등록된 구현이 없습니다.
Tasks
Reading ComprehensionTask 2Similar Papers 제목 키워드 기반
KARNA at COIN Shared Task 1: Bidirectional Encoder Representations from Transformers with relational knowledge for machine comprehension with common sense
This paper describes our model for COmmonsense INference in Natural Language Processing (COIN) shared task 1: Commonsense Inference in Everyday Narrations. This paper explores the use of Bidirectional Encoder Representat…
Common Sense ReasoningReading ComprehensionPingan Smart Health and SJTU at COIN - Shared Task: utilizing Pre-trained Language Models and Common-sense Knowledge in Machine Reading Tasks
To solve the shared tasks of COIN: COmmonsense INference in Natural Language Processing) Workshop in , we need explore the impact of knowledge representation in modeling commonsense knowledge to boost performance of mach…
Common Sense ReasoningMachine Reading ComprehensionReading ComprehensionTask 2+1Natural Language Processing with Commonsense Knowledge: A Survey
Commonsense knowledge is essential for advancing natural language processing (NLP) by enabling models to engage in human-like reasoning, which requires a deeper understanding of context and often involves making inferenc…
SurveyProceedings of the First Workshop on Commonsense Inference in Natural Language Processing
IIT-KGP at COIN 2019: Using pre-trained Language Models for modeling Machine Comprehension
In this paper, we describe our system for COIN 2019 Shared Task 1: Commonsense Inference in Everyday Narrations. We show the power of leveraging state-of-the-art pre-trained language models such as BERT(Bidirectional Enc…
PositionReading Comprehension