Mem2Seq: Effectively Incorporating Knowledge Bases into End-to-End Task-Oriented Dialog Systems
End-to-end task-oriented dialog systems usually suffer from the challenge of incorporating knowledge bases. In this paper, we propose a novel yet simple end-to-end differentiable model called memory-to-sequence (Mem2Seq) to address this issue. Mem2Seq is the first neural generative model that combines the multi-hop attention over memories with the idea of pointer network. We empirically show how Mem2Seq controls each generation step, and how its multi-hop attention mechanism helps in learning correlations between memories. In addition, our model is quite general without complicated task-specific designs. As a result, we show that Mem2Seq can be trained faster and attain the state-of-the-art performance on three different task-oriented dialog datasets.
Code (1)
Tasks
Task-Oriented Dialogue SystemsSimilar Papers 제목 키워드 기반
A Study of the Tasks and Models in Machine Reading Comprehension
To provide a survey on the existing tasks and models in Machine Reading Comprehension (MRC), this report reviews: 1) the dataset collection and performance evaluation of some representative simple-reasoning and complex-r…
Machine Reading ComprehensionReading ComprehensionTransfer LearningIntegrating knowledge bases to improve coreference and bridging resolution for the chemical domain
Resolving coreference and bridging relations in chemical patents is important for better understanding the precise chemical process, where chemical domain knowledge is very critical. We proposed an approach incorporating…
Chemical ProcessMulti-Task LearningIncorporating External Knowledge to Answer Open-Domain Visual Questions with Dynamic Memory Networks
Visual Question Answering (VQA) has attracted much attention since it offers insight into the relationships between the multi-modal analysis of images and natural language. Most of the current algorithms are incapable of…
Question AnsweringVisual Question AnsweringVisual Question Answering (VQA)Enhancing Review Comprehension with Domain-Specific Commonsense
Review comprehension has played an increasingly important role in improving the quality of online services and products and commonsense knowledge can further enhance review comprehension. However, existing general-purpos…
Aspect ExtractionKnowledge DistillationQuestion AnsweringSentiment Analysis+1A Simple Baseline for Knowledge-Based Visual Question Answering
This paper is on the problem of Knowledge-Based Visual Question Answering (KB-VQA). Recent works have emphasized the significance of incorporating both explicit (through external databases) and implicit (through LLMs) kn…
In-Context LearningQuestion AnsweringVisual Question AnsweringVisual Question Answering (VQA)