BERT with History Answer Embedding for Conversational Question Answering
Conversational search is an emerging topic in the information retrieval community. One of the major challenges to multi-turn conversational search is to model the conversation history to answer the current question. Existing methods either prepend history turns to the current question or use complicated attention mechanisms to model the history. We propose a conceptually simple yet highly effective approach referred to as history answer embedding. It enables seamless integration of conversation history into a conversational question answering (ConvQA) model built on BERT (Bidirectional Encoder Representations from Transformers). We first explain our view that ConvQA is a simplified but concrete setting of conversational search, and then we provide a general framework to solve ConvQA. We further demonstrate the effectiveness of our approach under this framework. Finally, we analyze the impact of different numbers of history turns under different settings to provide new insights into conversation history modeling in ConvQA.
Code (1)
Tasks
Conversational Question AnsweringConversational SearchInformation RetrievalQuestion AnsweringRetrievalMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Attentive History Selection for Conversational Question Answering
Conversational question answering (ConvQA) is a simplified but concrete setting of conversational search. One of its major challenges is to leverage the conversation history to understand and answer the current question.…
Conversational Question AnsweringConversational SearchMulti-Task LearningPosition+1BERT-CoQAC: BERT-based Conversational Question Answering in Context
As one promising way to inquire about any particular information through a dialog with the bot, question answering dialog systems have gained increasing research interests recently. Designing interactive QA systems has a…
Conversational Question AnsweringLanguage ModellingNatural Language UnderstandingQuestion Answering+1Technical report on Conversational Question Answering
Conversational Question Answering is a challenging task since it requires understanding of conversational history. In this project, we propose a new system RoBERTa + AT +KD, which involves rationale tagging multi-task, a…
Conversational Question AnsweringData AugmentationKnowledge DistillationQuestion AnsweringA Simple but Effective Method to Incorporate Multi-turn Context with BERT for Conversational Machine Comprehension
Conversational machine comprehension (CMC) requires understanding the context of multi-turn dialogue. Using BERT, a pre-training language model, has been successful for single-turn machine comprehension, while modeling m…
Language ModelingLanguage ModellingQuestion AnsweringReading ComprehensionBERT Embeddings Can Track Context in Conversational Search
The use of conversational assistants to search for information is becoming increasingly more popular among the general public, pushing the research towards more advanced and sophisticated techniques. In the last few year…
Conversational SearchRe-Ranking