Multi-Turn Response Selection for Chatbots with Deep Attention Matching Network
Human generates responses relying on semantic and functional dependencies, including coreference relation, among dialogue elements and their context. In this paper, we investigate matching a response with its multi-turn context using dependency information based entirely on attention. Our solution is inspired by the recently proposed Transformer in machine translation (Vaswani et al., 2017) and we extend the attention mechanism in two ways. First, we construct representations of text segments at different granularities solely with stacked self-attention. Second, we try to extract the truly matched segment pairs with attention across the context and response. We jointly introduce those two kinds of attention in one uniform neural network. Experiments on two large-scale multi-turn response selection tasks show that our proposed model significantly outperforms the state-of-the-art models.
Code (1)
Tasks
ChatbotConversational Response SelectionTranslationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Utterance-to-Utterance Interactive Matching Network for Multi-Turn Response Selection in Retrieval-Based Chatbots
This paper proposes an utterance-to-utterance interactive matching network (U2U-IMN) for multi-turn response selection in retrieval-based chatbots. Different from previous methods following context-to-response matching o…
Conversational Response SelectionRetrievalSentenceInteractive Matching Network for Multi-Turn Response Selection in Retrieval-Based Chatbots
In this paper, we propose an interactive matching network (IMN) for the multi-turn response selection task. First, IMN constructs word representations from three aspects to address the challenge of out-of-vocabulary (OOV…
Conversational Response SelectionDescriptiveRetrievalTripleNet: Triple Attention Network for Multi-Turn Response Selection in Retrieval-based Chatbots
We consider the importance of different utterances in the context for selecting the response usually depends on the current query. In this paper, we propose the model TripleNet to fully model the task with the triple <co…
Conversational Response SelectionRetrievalSpeaker-Aware BERT for Multi-Turn Response Selection in Retrieval-Based Chatbots
In this paper, we study the problem of employing pre-trained language models for multi-turn response selection in retrieval-based chatbots. A new model, named Speaker-Aware BERT (SA-BERT), is proposed in order to make th…
Conversational Response SelectionDisentanglementDomain AdaptationRetrievalSequential Matching Network: A New Architecture for Multi-turn Response Selection in Retrieval-based Chatbots
We study response selection for multi-turn conversation in retrieval-based chatbots. Existing work either concatenates utterances in context or matches a response with a highly abstract context vector finally, which may …
Conversational Response SelectionRetrieval