ConditionalQA: A Complex Reading Comprehension Dataset with Conditional Answers
We describe a Question Answering (QA) dataset that contains complex questions with conditional answers, i.e. the answers are only applicable when certain conditions apply. We call this dataset ConditionalQA. In addition to conditional answers, the dataset also features: (1) long context documents with information that is related in logically complex ways; (2) multi-hop questions that require compositional logical reasoning; (3) a combination of extractive questions, yes/no questions, questions with multiple answers, and not-answerable questions; (4) questions asked without knowing the answers. We show that ConditionalQA is challenging for many of the existing QA models, especially in selecting answer conditions. We believe that this dataset will motivate further research in answering complex questions over long documents. Data and leaderboard are publicly available at \url{https://github.com/haitian-sun/ConditionalQA}.
Code (2)
Tasks
Logical ReasoningQuestion AnsweringReading ComprehensionSimilar Papers 제목 키워드 기반
MDCR: A Dataset for Multi-Document Conditional Reasoning
The same real-life questions posed to different individuals may lead to different answers based on their unique situations. For instance, whether a student is eligible for a scholarship depends on eligibility conditions,…
ForceReader: a BERT-based Interactive Machine Reading Comprehension Model with Attention Separation
The release of BERT revolutionized the development of NLP. Various BERT-based reading comprehension models have been proposed, thus updating the performance ranking of reading comprehension tasks. However, the above BERT…
Machine Reading ComprehensionReading ComprehensionA Chinese Machine Reading Comprehension Dataset Automatic Generated Based on Knowledge Graph
“Machine reading comprehension (MRC) is a typical natural language processing (NLP)task and has developed rapidly in the last few years. Various reading comprehension datasets have been built to support MRC studies. Howe…
Dataset GenerationMachine Reading ComprehensionReading ComprehensionDataset for the First Evaluation on Chinese Machine Reading Comprehension
Machine Reading Comprehension (MRC) has become enormously popular recently and has attracted a lot of attention. However, existing reading comprehension datasets are mostly in English. To add diversity in reading compreh…
Chinese Reading ComprehensionDiversityMachine Reading ComprehensionReading ComprehensionChatPRCS: A Personalized Support System for English Reading Comprehension based on ChatGPT
As a common approach to learning English, reading comprehension primarily entails reading articles and answering related questions. However, the complexity of designing effective exercises results in students encounterin…
ArticlesQuestion GenerationQuestion-GenerationReading Comprehension