A Unified Query-based Generative Model for Question Generation and Question Answering
We propose a query-based generative model for solving both tasks of question generation (QG) and question an- swering (QA). The model follows the classic encoder- decoder framework. The encoder takes a passage and a query as input then performs query understanding by matching the query with the passage from multiple per- spectives. The decoder is an attention-based Long Short Term Memory (LSTM) model with copy and coverage mechanisms. In the QG task, a question is generated from the system given the passage and the target answer, whereas in the QA task, the answer is generated given the question and the passage. During the training stage, we leverage a policy-gradient reinforcement learning algorithm to overcome exposure bias, a major prob- lem resulted from sequence learning with cross-entropy loss. For the QG task, our experiments show higher per- formances than the state-of-the-art results. When used as additional training data, the automatically generated questions even improve the performance of a strong ex- tractive QA system. In addition, our model shows bet- ter performance than the state-of-the-art baselines of the generative QA task.
Code (0)
등록된 구현이 없습니다.
Tasks
DecoderQuestion AnsweringQuestion GenerationQuestion-GenerationReinforcement LearningSimilar Papers 제목 키워드 기반
UniGen: A Unified Generative Framework for Retrieval and Question Answering with Large Language Models
Generative information retrieval, encompassing two major tasks of Generative Document Retrieval (GDR) and Grounded Answer Generation (GAR), has gained significant attention in the area of information retrieval and natura…
Answer GenerationInformation RetrievalQuestion AnsweringRetrievalFormal Query Building with Query Structure Prediction for Complex Question Answering over Knowledge Base
Formal query building is an important part of complex question answering over knowledge bases. It aims to build correct executable queries for questions. Recent methods try to rank candidate queries generated by a state-…
DecoderGraph GenerationKnowledge Base Question AnsweringQuestion AnsweringA Unified Abstractive Model for Generating Question-Answer Pairs
Large-scale question-answer pairs (QAP) are valuable for many applications, such as knowledge bases construction and machine reading comprehension. Although its importance has been widely recognized, existing approaches …
Answer GenerationMachine Reading ComprehensionQuestion GenerationQuestion-Generation+1Evidence-Enhanced Triplet Generation Framework for Hallucination Alleviation in Generative Question Answering
To address the hallucination in generative question answering (GQA) where the answer can not be derived from the document, we propose a novel evidence-enhanced triplet generation framework, EATQA, encouraging the model t…
Generative Question AnsweringHallucinationQuestion AnsweringTripletGeneration of complex database queries and API calls from natural language utterances
Generating queries corresponding to natural language questions is a long standing problem. Traditional methods lack language flexibility, while newer sequence-to-sequence models require large amount of data. Schema-agnos…
intent-classificationIntent ClassificationIntent Classification and Slot Fillingslot-filling+1