Generating a Common Question from Multiple Documents using Multi-source Encoder-Decoder Models
Ambiguous user queries in search engines result in the retrieval of documents that often span multiple topics. One potential solution is for the search engine to generate multiple refined queries, each of which relates to a subset of the documents spanning the same topic. A preliminary step towards this goal is to generate a question that captures common concepts of multiple documents. We propose a new task of generating common question from multiple documents and present simple variant of an existing multi-source encoder-decoder framework, called the Multi-Source Question Generator (MSQG). We first train an RNN-based single encoder-decoder generator from (single document, question) pairs. At test time, given multiple documents, the 'Distribute' step of our MSQG model predicts target word distributions for each document using the trained model. The 'Aggregate' step aggregates these distributions to generate a common question. This simple yet effective strategy significantly outperforms several existing baseline models applied to the new task when evaluated using automated metrics and human judgments on the MS-MARCO-QA dataset.
Code (0)
등록된 구현이 없습니다.
Tasks
DecoderRetrievalMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Contrastive Multi-document Question Generation
Multi-document question generation focuses on generating a question that covers the common aspect of multiple documents. Such a model is useful in generating clarifying options. However, a naive model trained only using …
Contrastive LearningQuestion GenerationQuestion-GenerationReinforcement Learning+2Auto FAQ Generation
FAQ documents are commonly used with text documents and websites to provide important information in the form of question answer pairs to either aid in reading comprehension or provide a shortcut to the key ideas. We sup…
PhilosophyQuestion GenerationQuestion-GenerationReading Comprehension+2Mining both Commonality and Specificity from Multiple Documents for Multi-Document Summarization
The multi-document summarization task requires the designed summarizer to generate a short text that covers the important information of original documents and satisfies content diversity. This paper proposes a multi-doc…
DiversityDocument SummarizationMulti-Document SummarizationSpecificityAn Algorithm for Generating Gap-Fill Multiple Choice Questions of an Expert System
This research is aimed to propose an artificial intelligence algorithm comprising an ontology-based design, text mining, and natural language processing for automatically generating gap-fill multiple choice questions (MC…
Multiple-choicesoftware testingvalidA Simple and Effective Model for Multi-Hop Question Generation
Previous research on automated question generation has almost exclusively focused on generating factoid questions whose answers can be extracted from a single document. However, there is an increasing interest in develop…
Question GenerationQuestion-GenerationSentenceSentence Classification