paper-with-me

Papers

Unsupervised multiple-choice question generation for out-of-domain Q\&A fine-tuning

2021-11-16 · ACL ARR November 2021 11 · Anonymous

Pre-trained models have shown very good performances on a number of question answering benchmarks especially when fine-tuned on multiple question answering datasets at once. In this work, we propose an approach for generating a fine-tuning dataset thanks to a rule-based algorithm that generates questions and answers from unannotated sentences. We show that the state-of-the-art model UnifiedQA can greatly benefit from such a system on a multiple-choice benchmark about physics, biology and chemistry it has never been trained on. We further show that improved performances may be obtained by selecting the most challenging distractors (wrong answers), with a dedicated ranker based on a pretrained RoBERTa model.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

Multiple-choiceQuestion AnsweringQuestion GenerationQuestion-Generation

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Weight Decay 설명 없음
Refunds@Expedia|||How do I get a full refund from Expedia? “How do I get a full refund from Expedia? How do I get a full refund from Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Quick Help &…
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Linear Warmup With Linear Decay Linear Warmup With Linear Decay is a learning rate schedule in which we increase the learning rate linearly for $n$ updates and then linearly decay afterwards.

Similar Papers 제목 키워드 기반

Unsupervised multiple choices question answering via universal corpus

2024-02-27 · Qin Zhang, Hao Ge, Xiaojun Chen, Meng Fang

Unsupervised question answering is a promising yet challenging task, which alleviates the burden of building large-scale annotated data in a new domain. It motivates us to study the unsupervised multiple-choice question …

FormKnowledge GraphsMultiple-choiceMultiple Choice Question Answering (MCQA)+1

Unsupervised multiple-choice question generation for out-of-domain Q&A fine-tuning

2022-05-01 · ACL 2022 5 · Guillaume Le Berre, Christophe Cerisara, Philippe Langlais, Guy Lapalme

Pre-trained models have shown very good performances on a number of question answering benchmarks especially when fine-tuned on multiple question answering datasets at once. In this work, we propose an approach for gener…

Multiple-choiceQuestion AnsweringQuestion GenerationQuestion-Generation

Distractor Generation for Multiple Choice Questions Using Learning to Rank

2018-06-01 · WS 2018 6 · Chen Liang, Xiao Yang, Neisarg Dave, Drew Wham 외

We investigate how machine learning models, specifically ranking models, can be used to select useful distractors for multiple choice questions. Our proposed models can learn to select distractors that resemble those in …

BIG-bench Machine LearningDistractor GenerationEnsemble LearningLearning-To-Rank+1

Crowdsourcing Multiple Choice Science Questions

2017-07-19 · WS 2017 9 · Johannes Welbl, Nelson F. Liu, Matt Gardner

We present a novel method for obtaining high-quality, domain-targeted multiple choice questions from crowd workers. Generating these questions can be difficult without trading away originality, relevance or diversity in …

DiversityMultiple-choiceQuestion GenerationQuestion-Generation

Knowledge-Driven Distractor Generation for Cloze-style Multiple Choice Questions

2020-04-21 · Siyu Ren, Kenny Q. Zhu

In this paper, we propose a novel configurable framework to automatically generate distractive choices for open-domain cloze-style multiple-choice questions, which incorporates a general-purpose knowledge base to effecti…

Distractor GenerationLearning-To-RankMultiple-choice