Closed-book Question Generation via Contrastive Learning
Question Generation (QG) is a fundamental NLP task for many downstream applications. Recent studies on open-book QG, where supportive answer-context pairs are provided to models, have achieved promising progress. However, generating natural questions under a more practical closed-book setting that lacks these supporting documents still remains a challenge. In this work, we propose a new QG model for this closed-book setting that is designed to better understand the semantics of long-form abstractive answers and store more information in its parameters through contrastive learning and an answer reconstruction module. Through experiments, we validate the proposed QG model on both public datasets and a new WikiCQA dataset. Empirical results show that the proposed QG model outperforms baselines in both automatic evaluation and human evaluation. In addition, we show how to leverage the proposed model to improve existing question-answering systems. These results further indicate the effectiveness of our QG model for enhancing closed-book question-answering tasks.
Code (1)
Tasks
Contrastive LearningNatural QuestionsOpen-Domain Question AnsweringQuestion AnsweringQuestion GenerationQuestion-GenerationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Context Generation Improves Open Domain Question Answering
Closed-book question answering (QA) requires a model to directly answer an open-domain question without access to any external knowledge. Prior work on closed-book QA either directly finetunes or prompts a pretrained lan…
Language ModelingLanguage ModellingOpen-Domain Question AnsweringQuestion AnsweringQuery Refinement Prompts for Closed-Book Long-Form Question Answering
Large language models (LLMs) have been shown to perform well in answering questions and in producing long-form texts, both in few-shot closed-book settings. While the former can be validated using well-known evaluation m…
FormLong Form Question AnsweringQuestion AnsweringCan Generative Pre-trained Language Models Serve as Knowledge Bases for Closed-book QA?
Recent work has investigated the interesting question using pre-trained language models (PLMs) as knowledge bases for answering open questions. However, existing work is limited in using small benchmarks with high test-t…
Question AnsweringPerhaps PTLMs Should Go to School – A Task to Assess Open Book and Closed Book QA
Our goal is to deliver a new task and leaderboard to stimulate research on question answering and pre-trained language models (PTLMs) to understand a significant instructional document, e.g., an introductory college text…
Question AnsweringPerhaps PTLMs Should Go to School -- A Task to Assess Open Book and Closed Book QA
Our goal is to deliver a new task and leaderboard to stimulate research on question answering and pre-trained language models (PTLMs) to understand a significant instructional document, e.g., an introductory college text…
Question Answering