Getting Better Dialogue Context for Knowledge Identification by Leveraging Document-level Topic Shift
To build a goal-oriented dialogue system that can generate responses given a knowledge base, identifying the relevant pieces of information to be grounded in is vital. When the number of documents in the knowledge base is large, retrieval approaches are typically used to identify the top relevant documents. However, most prior work simply uses an entire dialogue history to guide retrieval, rather than exploiting a dialogue’s topical structure. In this work, we examine the importance of building the proper contextualized dialogue history when document-level topic shifts are present. Our results suggest that excluding irrelevant turns from the dialogue history (e.g., excluding turns not grounded in the same document as the current turn) leads to better retrieval results. We also propose a cascading approach utilizing the topical nature of a knowledge-grounded conversation to further manipulate the dialogue history used as input to the retrieval models.
Code (0)
등록된 구현이 없습니다.
Tasks
RetrievalSimilar Papers 제목 키워드 기반
DIALKI: Knowledge Identification in Conversational Systems through Dialogue-Document Contextualization
Identifying relevant knowledge to be used in conversational systems that are grounded in long documents is critical to effective response generation. We introduce a knowledge identification model that leverages the docum…
Response GenerationQuery Enhanced Knowledge-Intensive Conversation via Unsupervised Joint Modeling
In this paper, we propose an unsupervised query enhanced approach for knowledge-intensive conversations, namely QKConv. There are three modules in QKConv: a query generator, an off-the-shelf knowledge selector, and a res…
Conversational Question AnsweringQuestion AnsweringRetrievalPK-ICR: Persona-Knowledge Interactive Context Retrieval for Grounded Dialogue
Identifying relevant persona or knowledge for conversational systems is critical to grounded dialogue response generation. However, each grounding has been mostly researched in isolation with more practical multi-context…
Data AugmentationResponse GenerationRetrievalAnalyzing the Forgetting Problem in the Pretrain-Finetuning of Dialogue Response Models
In this work, we study how the finetuning stage in the pretrain-finetune framework changes the behavior of a pretrained neural language generator. We focus on the transformer encoder-decoder model for the open-domain dia…
DecoderResponse GenerationText GenerationTransfer LearningAnalyzing the Forgetting Problem in Pretrain-Finetuning of Open-domain Dialogue Response Models
In this work, we study how the finetuning stage in the pretrain-finetune framework changes the behavior of a pretrained neural language generator. We focus on the transformer encoder-decoder model for the open-domain dia…
DecoderResponse GenerationText GenerationTransfer Learning