Unsupervised multiple-choice question generation for out-of-domain Q&A fine-tuning
Pre-trained models have shown very good performances on a number of question answering benchmarks especially when fine-tuned on multiple question answering datasets at once. In this work, we propose an approach for generating a fine-tuning dataset thanks to a rule-based algorithm that generates questions and answers from unannotated sentences. We show that the state-of-the-art model UnifiedQA can greatly benefit from such a system on a multiple-choice benchmark about physics, biology and chemistry it has never been trained on. We further show that improved performances may be obtained by selecting the most challenging distractors (wrong answers), with a dedicated ranker based on a pretrained RoBERTa model.
Code (0)
등록된 구현이 없습니다.
Tasks
Multiple-choiceQuestion AnsweringQuestion GenerationQuestion-GenerationSimilar Papers 제목 키워드 기반
Unsupervised multiple choices question answering via universal corpus
Unsupervised question answering is a promising yet challenging task, which alleviates the burden of building large-scale annotated data in a new domain. It motivates us to study the unsupervised multiple-choice question …
FormKnowledge GraphsMultiple-choiceMultiple Choice Question Answering (MCQA)+1Unsupervised multiple-choice question generation for out-of-domain Q\&A fine-tuning
Pre-trained models have shown very good performances on a number of question answering benchmarks especially when fine-tuned on multiple question answering datasets at once. In this work, we propose an approach for gener…
Multiple-choiceQuestion AnsweringQuestion GenerationQuestion-GenerationDistractor Generation for Multiple Choice Questions Using Learning to Rank
We investigate how machine learning models, specifically ranking models, can be used to select useful distractors for multiple choice questions. Our proposed models can learn to select distractors that resemble those in …
BIG-bench Machine LearningDistractor GenerationEnsemble LearningLearning-To-Rank+1Crowdsourcing Multiple Choice Science Questions
We present a novel method for obtaining high-quality, domain-targeted multiple choice questions from crowd workers. Generating these questions can be difficult without trading away originality, relevance or diversity in …
DiversityMultiple-choiceQuestion GenerationQuestion-GenerationKnowledge-Driven Distractor Generation for Cloze-style Multiple Choice Questions
In this paper, we propose a novel configurable framework to automatically generate distractive choices for open-domain cloze-style multiple-choice questions, which incorporates a general-purpose knowledge base to effecti…
Distractor GenerationLearning-To-RankMultiple-choice