Consecutive Question Generation with Multitask Joint Reranking and Dynamic Rationale Search
Automatic question generation (QG) aims to generate a set of questions for a given passage, and can be viewed as a dual task of question answering (QA). However, most current methods of QG tend to generate question by question independently, mainly based on specific extracted answer spans. In this paper, we propose to consecutively generate questions over a whole passage, with a comprehensive consideration of the aspects including accuracy, diversity, informativeness, and coverage. First we exam four key elements in QG, i.e., question, answer, rationale, and context history, and propose a novel multitask framework with one main task generating a question-answer pair, and four auxiliary tasks generating other elements alternately, improving model performance from all aspects through both joint training and reranking. Further, to learn the connection between questions and fully exploit the important information in every sentence, we propose a new consecutive generation strategy, which dynamically selects the rationales and searches for the best question series globally. Extensive experiments on different datasets show that our method can improve question generation significantly and benefit multiple related NLP tasks.
Code (0)
등록된 구현이 없습니다.
Tasks
DiversityInformativenessQuestion AnsweringQuestion GenerationQuestion-GenerationRerankingSentenceSimilar Papers 제목 키워드 기반
Consecutive Question Generation via Dynamic Multitask Learning
In this paper, we propose the task of consecutive question generation (CQG), which generates a set of logically related question-answer pairs to understand a whole passage, with a comprehensive consideration of the aspec…
Data AugmentationInformativenessQuestion GenerationQuestion-Generation+1Enhancing Financial Report Question-Answering: A Retrieval-Augmented Generation System with Reranking Analysis
Financial analysts face significant challenges extracting information from lengthy 10-K reports, which often exceed 100 pages. This paper presents a Retrieval-Augmented Generation (RAG) system designed to answer question…
Semantic RetrievalList-aware Reranking-Truncation Joint Model for Search and Retrieval-augmented Generation
The results of information retrieval (IR) are usually presented in the form of a ranked list of candidate documents, such as web search for humans and retrieval-augmented generation for large language models (LLMs). List…
Information RetrievalLearning-To-RankMisinformationReranking+2Joint Multitask Learning for Community Question Answering Using Task-Specific Embeddings
We address jointly two important tasks for Question Answering in community forums: given a new question, (i) find related existing questions, and (ii) find relevant answers to this new question. We further use an auxilia…
Community Question AnsweringQuestion AnsweringMultimodal Reranking for Knowledge-Intensive Visual Question Answering
Knowledge-intensive visual question answering requires models to effectively use external knowledge to help answer visual questions. A typical pipeline includes a knowledge retriever and an answer generator. However, a r…
Answer GenerationQuestion AnsweringRerankingVisual Question Answering+1