Iterative GNN-based Decoder for Question Generation
Natural question generation (QG) aims to generate questions from a passage, and generated questions are answered from the passage. Most models with state-of-the-art performance model the previously generated text at each decoding step. However, (1) they ignore the rich structure information that is hidden in the previously generated text. (2) they ignore the impact of copied words on the passage. We perceive that information in previously generated words serves as auxiliary information in subsequent generation. To address these problems, we design the Iterative Graph Network-based Decoder (IGND) to model the previous generation using a Graph Neural Network at each decoding step. Moreover, our graph model captures dependency relations in the passage that boost the generation. Experimental results demonstrate that our model outperforms the state-of-the-art models with sentence-level QG tasks on SQuAD and MARCO datasets.
Code (1)
Tasks
DecoderGraph Neural NetworkQuestion GenerationQuestion-GenerationSentenceMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
ReDecode Framework for Iterative Improvement in Paraphrase Generation
Generating paraphrases, that is, different variations of a sentence conveying the same meaning, is an important yet challenging task in NLP. Automatically generating paraphrases has its utility in many NLP tasks like que…
DecoderInformation RetrievalParaphrase GenerationQuestion Answering+2Entailment Tree Explanations via Iterative Retrieval-Generation Reasoner
Large language models have achieved high performance on various question answering (QA) benchmarks, but the explainability of their output remains elusive. Structured explanations, called entailment trees, were recently …
DecoderQuestion AnsweringRetrievalUniGen: A Unified Generative Framework for Retrieval and Question Answering with Large Language Models
Generative information retrieval, encompassing two major tasks of Generative Document Retrieval (GDR) and Grounded Answer Generation (GAR), has gained significant attention in the area of information retrieval and natura…
Answer GenerationInformation RetrievalQuestion AnsweringRetrievalLearning to Ask Questions in Open-domain Conversational Systems with Typed Decoders
Asking good questions in large-scale, open-domain conversational systems is quite significant yet rather untouched. This task, substantially different from traditional question generation, requires to question not only w…
DecoderQuestion GenerationQuestion-GenerationSentenceNeural Question Generation from Text: A Preliminary Study
Automatic question generation aims to generate questions from a text passage where the generated questions can be answered by certain sub-spans of the given passage. Traditional methods mainly use rigid heuristic rules t…
DecoderPositionQuestion GenerationQuestion-Generation+1