IIT-KGP at COIN 2019: Using pre-trained Language Models for modeling Machine Comprehension
In this paper, we describe our system for COIN 2019 Shared Task 1: Commonsense Inference in Everyday Narrations. We show the power of leveraging state-of-the-art pre-trained language models such as BERT(Bidirectional Encoder Representations from Transformers) and XLNet over other Commonsense Knowledge Base Resources such as ConceptNet and NELL for modeling machine comprehension. We used an ensemble of BERT-Large and XLNet-Large. Experimental results show that our model give substantial improvements over the baseline and other systems incorporating knowledge bases. We bagged 2nd position on the final test set leaderboard with an accuracy of 90.5{\%}
Code (0)
등록된 구현이 없습니다.
Tasks
PositionReading ComprehensionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Pingan Smart Health and SJTU at COIN - Shared Task: utilizing Pre-trained Language Models and Common-sense Knowledge in Machine Reading Tasks
To solve the shared tasks of COIN: COmmonsense INference in Natural Language Processing) Workshop in , we need explore the impact of knowledge representation in modeling commonsense knowledge to boost performance of mach…
Common Sense ReasoningMachine Reading ComprehensionReading ComprehensionTask 2+1KARNA at COIN Shared Task 1: Bidirectional Encoder Representations from Transformers with relational knowledge for machine comprehension with common sense
This paper describes our model for COmmonsense INference in Natural Language Processing (COIN) shared task 1: Commonsense Inference in Everyday Narrations. This paper explores the use of Bidirectional Encoder Representat…
Common Sense ReasoningReading ComprehensionAdvances in Multi-turn Dialogue Comprehension: A Survey
Training machines to understand natural language and interact with humans is an elusive and essential task of artificial intelligence. A diversity of dialogue systems has been designed with the rapid development of deep …
DiversityLanguage ModellingQuestion AnsweringReading Comprehension+1Advances in Multi-turn Dialogue Comprehension: A Survey
Training machines to understand natural language and interact with humans is an elusive and essential task of artificial intelligence. A diversity of dialogue systems has been designed with the rapid development of deep …
DiversityReading ComprehensionSurveyCommonsense Inference in Natural Language Processing (COIN) - Shared Task Report
This paper reports on the results of the shared tasks of the COIN workshop at EMNLP-IJCNLP 2019. The tasks consisted of two machine comprehension evaluations, each of which tested a system{'}s ability to answer questions…
Reading ComprehensionTask 2