Keyword Extraction for Improved Document Retrieval in Conversational Search
Recent research has shown that mixed-initiative conversational search, based on the interaction between users and computers to clarify and improve a query, provides enormous advantages. Nonetheless, incorporating additional information provided by the user from the conversation poses some challenges. In fact, further interactions could confuse the system as a user might use words irrelevant to the information need but crucial for correct sentence construction in the context of multi-turn conversations. To this aim, in this paper, we have collected two conversational keyword extraction datasets and propose an end-to-end document retrieval pipeline incorporating them. Furthermore, we study the performance of two neural keyword extraction models, namely, BERT and sequence to sequence, in terms of extraction accuracy and human annotation. Finally, we study the effect of keyword extraction on the end-to-end neural IR performance and show that our approach beats state-of-the-art IR models. We make the two datasets publicly available to foster research in this area.
Code (0)
등록된 구현이 없습니다.
Tasks
Conversational SearchKeyword ExtractionRetrievalSentenceMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
RaKUn: Rank-based Keyword extraction via Unsupervised learning and Meta vertex aggregation
Keyword extraction is used for summarizing the content of a document and supports efficient document retrieval, and is as such an indispensable part of modern text-based systems. We explore how load centrality, a graph-t…
Keyword ExtractionRetrievalApplying Graph-based Keyword Extraction to Document Retrieval
An Improved Method for Class-specific Keyword Extraction: A Case Study in the German Business Registry
The task of $\textit{keyword extraction}$ is often an important initial step in unsupervised information extraction, forming the basis for tasks such as topic modeling or document classification. While recent methods hav…
Document ClassificationKeyword ExtractionKeyword-Guided Neural Conversational Model
We study the problem of imposing conversational goals/keywords on open-domain conversational agents, where the agent is required to lead the conversation to a target keyword smoothly and fast. Solving this problem enable…
Knowledge GraphsmodelRetrievalWord EmbeddingsComplex Network based Supervised Keyword Extractor
In this paper, we present a supervised framework for automatic keyword extraction from single document. We model the text as complex network, and construct the feature set by extracting select node properties from it. Se…
Keyphrase ExtractionKeyword Extraction