Incorporating Loose-Structured Knowledge into Conversation Modeling via Recall-Gate LSTM
Modeling human conversations is the essence for building satisfying chat-bots with multi-turn dialog ability. Conversation modeling will notably benefit from domain knowledge since the relationships between sentences can be clarified due to semantic hints introduced by knowledge. In this paper, a deep neural network is proposed to incorporate background knowledge for conversation modeling. Through a specially designed Recall gate, domain knowledge can be transformed into the extra global memory of Long Short-Term Memory (LSTM), so as to enhance LSTM by cooperating with its local memory to capture the implicit semantic relevance between sentences within conversations. In addition, this paper introduces the loose structured domain knowledge base, which can be built with slight amount of manual work and easily adopted by the Recall gate. Our model is evaluated on the context-oriented response selecting task, and experimental results on both two datasets have shown that our approach is promising for modeling human conversations and building key components of automatic chatting systems.
Code (1)
Similar Papers 제목 키워드 기반
Extending Neural Generative Conversational Model using External Knowledge Sources
The use of connectionist approaches in conversational agents has been progressing rapidly due to the availability of large corpora. However current generative dialogue models often lack coherence and are content poor. Th…
Beyond Domain APIs: Task-oriented Conversational Modeling with Unstructured Knowledge Access Track in DSTC9
Most prior work on task-oriented dialogue systems are restricted to a limited coverage of domain APIs, while users oftentimes have domain related requests that are not covered by the APIs. This challenge track aims to ex…
Response GenerationTask-Oriented Dialogue SystemsBeyond Domain APIs: Task-oriented Conversational Modeling with Unstructured Knowledge Access
Most prior work on task-oriented dialogue systems are restricted to a limited coverage of domain APIs, while users oftentimes have domain related requests that are not covered by the APIs. In this paper, we propose to ex…
Response GenerationTask-Oriented Dialogue SystemsKnow Deeper: Knowledge-Conversation Cyclic Utilization Mechanism for Open-domain Dialogue Generation
End-to-End intelligent neural dialogue systems suffer from the problems of generating inconsistent and repetitive responses. Existing dialogue models pay attention to unilaterally incorporating personal knowledge into th…
DecoderDialogue GenerationResponse GenerationUnstructured Text Enhanced Open-domain Dialogue System: A Systematic Survey
Incorporating external knowledge into dialogue generation has been proven to benefit the performance of an open-domain Dialogue System (DS), such as generating informative or stylized responses, controlling conversation …
Dialogue GenerationResponse GenerationRetrievalSurvey