Towards Inference-Oriented Reading Comprehension: ParallelQA
In this paper, we investigate the tendency of end-to-end neural Machine Reading Comprehension (MRC) models to match shallow patterns rather than perform inference-oriented reasoning on RC benchmarks. We aim to test the ability of these systems to answer questions which focus on referential inference. We propose ParallelQA, a strategy to formulate such questions using parallel passages. We also demonstrate that existing neural models fail to generalize well to this setting.
Code (0)
등록된 구현이 없습니다.
Tasks
Machine Reading ComprehensionReading ComprehensionSimilar Papers 제목 키워드 기반
An Understanding-Oriented Robust Machine Reading Comprehension Model
Although existing machine reading comprehension models are making rapid progress on many datasets, they are far from robust. In this paper, we propose an understanding-oriented machine reading comprehension model to addr…
Machine Reading ComprehensionmodelMulti-Task LearningNatural Language Inference+2Graph Representations for Reading Comprehension Analysis using Large Language Model and Eye-Tracking Biomarker
Reading comprehension is a fundamental skill in human cognitive development. With the advancement of Large Language Models (LLMs), there is a growing need to compare how humans and LLMs understand language across differe…
Emotion InterpretationReading ComprehensionInformation RetrievalAudio-Oriented Multimodal Machine Comprehension: Task, Dataset and Model
While Machine Comprehension (MC) has attracted extensive research interests in recent years, existing approaches mainly belong to the category of Machine Reading Comprehension task which mines textual inputs (paragraphs …
Knowledge DistillationMachine Reading ComprehensionReading ComprehensionNUT-RC: Noisy User-generated Text-oriented Reading Comprehension
Reading comprehension (RC) on social media such as Twitter is a critical and challenging task due to its noisy, informal, but informative nature. Most existing RC models are developed on formal datasets such as news arti…
Answer SelectionArticlesMulti-Task LearningReading ComprehensionReading Comprehension Ability Test-A Turing Test for Reading Comprehension
Reading comprehension is an important ability of human intelligence. Literacy and numeracy are two most essential foundation for people to succeed at study, at work and in life. Reading comprehension ability is a core co…
Reading Comprehension