paper-with-me

홈 › Papers

DialoKG: Knowledge-Structure Aware Task-Oriented Dialogue Generation

2022-04-19 · Findings (NAACL) 2022 7 · Md Rashad Al Hasan Rony, Ricardo Usbeck, Jens Lehmann

Task-oriented dialogue generation is challenging since the underlying knowledge is often dynamic and effectively incorporating knowledge into the learning process is hard. It is particularly challenging to generate both human-like and informative responses in this setting. Recent research primarily focused on various knowledge distillation methods where the underlying relationship between the facts in a knowledge base is not effectively captured. In this paper, we go one step further and demonstrate how the structural information of a knowledge graph can improve the system's inference capabilities. Specifically, we propose DialoKG, a novel task-oriented dialogue system that effectively incorporates knowledge into a language model. Our proposed system views relational knowledge as a knowledge graph and introduces (1) a structure-aware knowledge embedding technique, and (2) a knowledge graph-weighted attention masking strategy to facilitate the system selecting relevant information during the dialogue generation. An empirical evaluation demonstrates the effectiveness of DialoKG over state-of-the-art methods on several standard benchmark datasets.

📄 PDF Abstract BibTeX arXiv:2204.09149

Code (1)

rashad101/dialokg 공식 구현 pytorch

Tasks

Dialogue GenerationKnowledge DistillationLanguage ModelingLanguage Modelling

Methods 이 논문이 사용한 방법론

BASE 설명 없음
Knowledge Distillation A very simple way to improve the performance of almost any machine learning algorithm is to train many different models on the same data and then to average their predictions.…

Similar Papers 제목 키워드 기반

Topic-Aware Response Generation in Task-Oriented Dialogue with Unstructured Knowledge Access

2022-12-10 · Yue Feng, Gerasimos Lampouras, Ignacio Iacobacci

To alleviate the problem of structured databases' limited coverage, recent task-oriented dialogue systems incorporate external unstructured knowledge to guide the generation of system responses. However, these usually us…

Response GenerationSentenceTask-Oriented Dialogue Systems

Topic-Aware Response Generation in Task-Oriented Dialogue with Unstructured Knowledge Access

2021-11-16 · ACL ARR November 2021 11 · Anonymous

To alleviate the problem of structured databases' limited coverage, recent task-oriented dialogue systems incorporate external unstructured knowledge to guide the generation of system responses. However, these usually us…

Response GenerationSentenceTask-Oriented Dialogue Systems

Incorporating Dual-Aware with Hierarchical Interactive Memory Networks for Task-Oriented Dialogue

2021-11-16 · ACL ARR November 2021 11 · Anonymous

Recent years, end-to-end task-oriented dialogue systems have made a remarkable breakthrough. However, existing dialogue models tend to equally summarize all the history as the context representation and apply memory netw…

Task-Oriented Dialogue Systems

Learning to Retrieve Entity-Aware Knowledge and Generate Responses with Copy Mechanism for Task-Oriented Dialogue Systems

2020-12-22 · Chao-Hong Tan, Xiaoyu Yang, Zi'ou Zheng, Tianda Li 외

Task-oriented conversational modeling with unstructured knowledge access, as track 1 of the 9th Dialogue System Technology Challenges (DSTC 9), requests to build a system to generate response given dialogue history and k…

Response GenerationTask-Oriented Dialogue Systems

HyKnow: End-to-End Task-Oriented Dialog Modeling with Hybrid Knowledge Management

2021-05-13 · Findings (ACL) 2021 8 · Silin Gao, Ryuichi Takanobu, Wei Peng, Qun Liu 외

Task-oriented dialog (TOD) systems typically manage structured knowledge (e.g. ontologies and databases) to guide the goal-oriented conversations. However, they fall short of handling dialog turns grounded on unstructure…

ManagementRetrieval