Automating Reading Comprehension by Generating Question and Answer Pairs
Neural network-based methods represent the state-of-the-art in question generation from text. Existing work focuses on generating only questions from text without concerning itself with answer generation. Moreover, our analysis shows that handling rare words and generating the most appropriate question given a candidate answer are still challenges facing existing approaches. We present a novel two-stage process to generate question-answer pairs from the text. For the first stage, we present alternatives for encoding the span of the pivotal answer in the sentence using Pointer Networks. In our second stage, we employ sequence to sequence models for question generation, enhanced with rich linguistic features. Finally, global attention and answer encoding are used for generating the question most relevant to the answer. We motivate and linguistically analyze the role of each component in our framework and consider compositions of these. This analysis is supported by extensive experimental evaluations. Using standard evaluation metrics as well as human evaluations, our experimental results validate the significant improvement in the quality of questions generated by our framework over the state-of-the-art. The technique presented here represents another step towards more automated reading comprehension assessment. We also present a live system \footnote{Demo of the system is available at \url{https://www.cse.iitb.ac.in/~vishwajeet/autoqg.html}.} to demonstrate the effectiveness of our approach.
Code (0)
등록된 구현이 없습니다.
Tasks
Answer GenerationQuestion GenerationQuestion-GenerationReading ComprehensionSentenceSimilar Papers 제목 키워드 기반
Learning to Ask Unanswerable Questions for Machine Reading Comprehension
Machine reading comprehension with unanswerable questions is a challenging task. In this work, we propose a data augmentation technique by automatically generating relevant unanswerable questions according to an answerab…
Data AugmentationMachine Reading ComprehensionQuestion GenerationQuestion-Generation+1JEFF - Just Another EFFicient Reading Comprehension Test Generation
We introduce a method for generating vocabulary questions on reading comprehension of a given English article. In our approach, the method involves selecting target words in the given English article, finding synonyms as…
Question GenerationQuestion-GenerationReading ComprehensionAutomatically generating question-answer pairs for assessing basic reading comprehension in Swedish
This paper presents an evaluation of the quality of automatically generated reading comprehension questions from Swedish text, using the Quinductor method. This method is a light-weight, data-driven but non-neural method…
Question GenerationQuestion-GenerationReading ComprehensionChatPRCS: A Personalized Support System for English Reading Comprehension based on ChatGPT
As a common approach to learning English, reading comprehension primarily entails reading articles and answering related questions. However, the complexity of designing effective exercises results in students encounterin…
ArticlesQuestion GenerationQuestion-GenerationReading ComprehensionCan LLMs Grade Short-Answer Reading Comprehension Questions : An Empirical Study with a Novel Dataset
Open-ended questions, which require students to produce multi-word, nontrivial responses, are a popular tool for formative assessment as they provide more specific insights into what students do and don't know. However, …
Decision MakingPrompt EngineeringReading ComprehensionTransfer Learning