A Knowledge-Grounded Dialog System Based on Pre-Trained Language Models
We present a knowledge-grounded dialog system developed for the ninth Dialog System Technology Challenge (DSTC9) Track 1 - Beyond Domain APIs: Task-oriented Conversational Modeling with Unstructured Knowledge Access. We leverage transfer learning with existing language models to accomplish the tasks in this challenge track. Specifically, we divided the task into four sub-tasks and fine-tuned several Transformer models on each of the sub-tasks. We made additional changes that yielded gains in both performance and efficiency, including the combination of the model with traditional entity-matching techniques, and the addition of a pointer network to the output layer of the language model.
Code (0)
등록된 구현이 없습니다.
Tasks
Language ModelingLanguage ModellingTransfer LearningMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Knowledge-Grounded Dialogue Generation with a Unified Knowledge Representation
Knowledge-grounded dialogue systems are challenging to build due to the lack of training data and heterogeneous knowledge sources. Existing systems perform poorly on unseen topics due to limited topics covered in the tra…
Dialogue GenerationLanguage ModelingLanguage ModellingA Model of Cross-Lingual Knowledge-Grounded Response Generation for Open-Domain Dialogue Systems
Research on open-domain dialogue systems that allow free topics is challenging in the field of natural language processing (NLP). The performance of the dialogue system has been improved recently by the method utilizing …
Language ModelingLanguage ModellingResponse GenerationKnowledge-Grounded Dialogue Generation with a Unified Knowledge Representation
Knowledge-grounded dialogue systems are challenging to build due to the lack of training data and heterogeneous knowledge sources. Existing systems perform poorly on unseen topics due to limited topics covered in the tra…
Dialogue GenerationLanguage ModelingLanguage ModellingKnowledge-Grounded Dialogue Generation with Pre-trained Language Models
We study knowledge-grounded dialogue generation with pre-trained language models. To leverage the redundant external knowledge under capacity constraint, we propose equipping response generation defined by a pre-trained …
Dialogue GenerationLanguage ModelingLanguage ModellingResponse GenerationEvaluating Attribution in Dialogue Systems: The BEGIN Benchmark
Knowledge-grounded dialogue systems powered by large language models often generate responses that, while fluent, are not attributable to a relevant source of information. Progress towards models that do not exhibit this…
Language ModellingNatural Language Inference