BERT Embeddings Can Track Context in Conversational Search
The use of conversational assistants to search for information is becoming increasingly more popular among the general public, pushing the research towards more advanced and sophisticated techniques. In the last few years, in particular, the interest in conversational search is increasing, not only because of the generalization of conversational assistants but also because conversational search is a step forward in allowing a more natural interaction with the system. In this work, the focus is on exploring the context present of the conversation via the historical utterances and respective embeddings with the aim of developing a conversational search system that helps people search for information in a natural way. In particular, this system must be able to understand the context where the question is posed, tracking the current state of the conversation and detecting mentions to previous questions and answers. We achieve this by using a context-tracking component based on neural query-rewriting models. Another crucial aspect of the system is to provide the most relevant answers given the question and the conversational history. To achieve this objective, we used a Transformer-based re-ranking method and expanded this architecture to use the conversational context. The results obtained with the system developed showed the advantages of using the context present in the natural language utterances and in the neural embeddings generated throughout the conversation.
Code (0)
등록된 구현이 없습니다.
Tasks
Conversational SearchRe-RankingSimilar Papers 제목 키워드 기반
Gated Embeddings in End-to-End Speech Recognition for Conversational-Context Fusion
We present a novel conversational-context aware end-to-end speech recognizer based on a gated neural network that incorporates conversational-context/word/speech embeddings. Unlike conventional speech recognition models,…
SentenceSentence Embeddingsspeech-recognitionSpeech RecognitionDeveloping Conversational Data and Detection of Conversational Humor in Telugu
In the field of humor research, there has been a recent surge of interest in the sub-domain of Conversational Humor (CH). This study has two main objectives. (a) develop a conversational (humorous and non-humorous) datas…
Transfer LearningWord EmbeddingsTREC CAsT 2019: The Conversational Assistance Track Overview
The Conversational Assistance Track (CAsT) is a new track for TREC 2019 to facilitate Conversational Information Seeking (CIS) research and to create a large-scale reusable test collection for conversational search syste…
Conversational SearchLearning-To-RankMachine Reading ComprehensionReading Comprehension+2Context-Dependent Embedding Utterance Representations for Emotion Recognition in Conversations
Emotion Recognition in Conversations (ERC) has been gaining increasing importance as conversational agents become more and more common. Recognizing emotions is key for effective communication, being a crucial component i…
ClassificationEmotion RecognitionEmotion Recognition in ConversationCompositional and Lexical Semantics in RoBERTa, BERT and DistilBERT: A Case Study on CoQA
Many NLP tasks have benefited from transferring knowledge from contextualized word embeddings, however the picture of what type of knowledge is transferred is incomplete. This paper studies the types of linguistic phenom…
Conversational Question AnsweringNegationQuestion AnsweringSemantic Role Labeling+1