Learning Knowledge Bases with Parameters for Task-Oriented Dialogue Systems
Task-oriented dialogue systems are either modularized with separate dialogue state tracking (DST) and management steps or end-to-end trainable. In either case, the knowledge base (KB) plays an essential role in fulfilling user requests. Modularized systems rely on DST to interact with the KB, which is expensive in terms of annotation and inference time. End-to-end systems use the KB directly as input, but they cannot scale when the KB is larger than a few hundred entries. In this paper, we propose a method to embed the KB, of any size, directly into the model parameters. The resulting model does not require any DST or template responses, nor the KB as input, and it can dynamically update its KB via fine-tuning. We evaluate our solution in five task-oriented dialogue datasets with small, medium, and large KB size. Our experiments show that end-to-end models can effectively embed knowledge bases in their parameters and achieve competitive performance in all evaluated datasets.
Code (1)
Tasks
Dialogue State TrackingManagementTask-Oriented Dialogue SystemsMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Learning Knowledge Bases with Parameters for Task-Oriented Dialogue Systems
Task-oriented dialogue systems are either modularized with separate dialogue state tracking (DST) and management steps or end-to-end trainable. In either case, the knowledge base (KB) plays an essential role in fulfillin…
Dialogue State TrackingManagementTask-Oriented Dialogue SystemsQ-TOD: A Query-driven Task-oriented Dialogue System
Existing pipelined task-oriented dialogue systems usually have difficulties adapting to unseen domains, whereas end-to-end systems are plagued by large-scale knowledge bases in practice. In this paper, we introduce a nov…
Domain AdaptationResponse GenerationRetrievalTask-Oriented Dialogue SystemsTopic-Aware Response Generation in Task-Oriented Dialogue with Unstructured Knowledge Access
To alleviate the problem of structured databases' limited coverage, recent task-oriented dialogue systems incorporate external unstructured knowledge to guide the generation of system responses. However, these usually us…
Response GenerationSentenceTask-Oriented Dialogue SystemsTopic-Aware Response Generation in Task-Oriented Dialogue with Unstructured Knowledge Access
To alleviate the problem of structured databases' limited coverage, recent task-oriented dialogue systems incorporate external unstructured knowledge to guide the generation of system responses. However, these usually us…
Response GenerationSentenceTask-Oriented Dialogue SystemsGraphDialog: Integrating Graph Knowledge into End-to-End Task-Oriented Dialogue Systems
End-to-end task-oriented dialogue systems aim to generate system responses directly from plain text inputs. There are two challenges for such systems: one is how to effectively incorporate external knowledge bases (KBs) …
Dependency ParsingRepresentation LearningTask-Oriented Dialogue Systems