Entity-Consistent End-to-end Task-Oriented Dialogue System with KB Retriever
Querying the knowledge base (KB) has long been a challenge in the end-to-end task-oriented dialogue system. Previous sequence-to-sequence (Seq2Seq) dialogue generation work treats the KB query as an attention over the entire KB, without the guarantee that the generated entities are consistent with each other. In this paper, we propose a novel framework which queries the KB in two steps to improve the consistency of generated entities. In the first step, inspired by the observation that a response can usually be supported by a single KB row, we introduce a KB retrieval component which explicitly returns the most relevant KB row given a dialogue history. The retrieval result is further used to filter the irrelevant entities in a Seq2Seq response generation model to improve the consistency among the output entities. In the second step, we further perform the attention mechanism to address the most correlated KB column. Two methods are proposed to make the training feasible without labeled retrieval data, which include distant supervision and Gumbel-Softmax technique. Experiments on two publicly available task oriented dialog datasets show the effectiveness of our model by outperforming the baseline systems and producing entity-consistent responses.
Code (1)
Tasks
Dialogue GenerationResponse GenerationRetrievalTask-Oriented Dialogue SystemsMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Data-Efficient Goal-Oriented Conversation with Dialogue Knowledge Transfer Networks
Goal-oriented dialogue systems are now being widely adopted in industry where it is of key importance to maintain a rapid prototyping cycle for new products and domains. Data-driven dialogue system development has to be …
Dialogue GenerationFew-Shot LearningGoal-Oriented Dialogue SystemsTransfer LearningSemantics-Enhanced Task-Oriented Dialogue Translation: A Case Study on Hotel Booking
We showcase TODAY, a semantics-enhanced task-oriented dialogue translation system, whose novelties are: (i) task-oriented named entity (NE) definition and a hybrid strategy for NE recognition and translation; and (ii) a …
Dialogue UnderstandingMachine TranslationManagementNamed Entity Recognition (NER)+1Contextualize Knowledge Bases with Transformer for End-to-end Task-Oriented Dialogue Systems
Incorporating knowledge bases (KB) into end-to-end task-oriented dialogue systems is challenging, since it requires to properly represent the entity of KB, which is associated with its KB context and dialogue context. Th…
Response GenerationTask-Oriented Dialogue SystemsKETOD: Knowledge-Enriched Task-Oriented Dialogue
Existing studies in dialogue system research mostly treat task-oriented dialogue and chit-chat as separate domains. Towards building a human-like assistant that can converse naturally and seamlessly with users, it is imp…
Response GenerationKETOD: Knowledge-Enriched Task-Oriented Dialogue
Existing studies in dialogue system research mostly treat task-oriented dialogue and chit-chat separately. Towards building a human-like assistant that can converse naturally and seamlessly with users, the system needs t…
Response Generation