Question Generation by Transformers
A machine learning model was developed to automatically generate questions from Wikipedia passages using transformers, an attention-based model eschewing the paradigm of existing recurrent neural networks (RNNs). The model was trained on the inverted Stanford Question Answering Dataset (SQuAD), which is a reading comprehension dataset consisting of 100,000+ questions posed by crowdworkers on a set of Wikipedia articles. After training, the question generation model is able to generate simple questions relevant to unseen passages and answers containing an average of 8 words per question. The word error rate (WER) was used as a metric to compare the similarity between SQuAD questions and the model-generated questions. Although the high average WER suggests that the questions generated differ from the original SQuAD questions, the questions generated are mostly grammatically correct and plausible in their own right.
Code (1)
Tasks
ArticlesQuestion AnsweringQuestion GenerationQuestion-GenerationReading ComprehensionSimilar Papers 제목 키워드 기반
Self-Attention Architectures for Answer-Agnostic Neural Question Generation
Neural architectures based on self-attention, such as Transformers, recently attracted interest from the research community, and obtained significant improvements over the state of the art in several tasks. We explore ho…
Question GenerationQuestion-GenerationWord EmbeddingsDownstream Transformer Generation of Question-Answer Pairs with Preprocessing and Postprocessing Pipelines
We present a system called TP3 to perform a downstream task of transformers on generating question-answer pairs (QAPs) from a given article. TP3 first finetunes pretrained transformers on QAP datasets, then uses a prepro…
s2s-ft: Fine-Tuning Pretrained Transformer Encoders for Sequence-to-Sequence Learning
Pretrained bidirectional Transformers, such as BERT, have achieved significant improvements in a wide variety of language understanding tasks, while it is not straightforward to directly apply them for natural language g…
Abstractive Text SummarizationQuestion GenerationQuestion-GenerationText GenerationECIS-VQG: Generation of Entity-centric Information-seeking Questions from Videos
Previous studies on question generation from videos have mostly focused on generating questions about common objects and attributes and hence are not entity-centric. In this work, we focus on the generation of entity-cen…
Fact CheckingQuestion GenerationQuestion-GenerationStronger Transformers for Neural Multi-Hop Question Generation
Prior work on automated question generation has almost exclusively focused on generating simple questions whose answers can be extracted from a single document. However, there is an increasing interest in developing syst…
Question GenerationQuestion-Generation