Weakly-Supervised Open-Retrieval Conversational Question Answering
Recent studies on Question Answering (QA) and Conversational QA (ConvQA) emphasize the role of retrieval: a system first retrieves evidence from a large collection and then extracts answers. This open-retrieval ConvQA setting typically assumes that each question is answerable by a single span of text within a particular passage (a span answer). The supervision signal is thus derived from whether or not the system can recover an exact match of this ground-truth answer span from the retrieved passages. This method is referred to as span-match weak supervision. However, information-seeking conversations are challenging for this span-match method since long answers, especially freeform answers, are not necessarily strict spans of any passage. Therefore, we introduce a learned weak supervision approach that can identify a paraphrased span of the known answer in a passage. Our experiments on QuAC and CoQA datasets show that the span-match weak supervisor can only handle conversations with span answers, and has less satisfactory results for freeform answers generated by people. Our method is more flexible as it can handle both span answers and freeform answers. Moreover, our method can be more powerful when combined with the span-match method which shows it is complementary to the span-match method. We also conduct in-depth analyses to show more insights on open-retrieval ConvQA under a weak supervision setting.
Code (1)
Tasks
Conversational Question AnsweringQuestion AnsweringRetrievalSimilar Papers 제목 키워드 기반
A Dataset for Sentence Retrieval for Open-Ended Dialogues
We address the task of sentence retrieval for open-ended dialogues. The goal is to retrieve sentences from a document corpus that contain information useful for generating the next turn in a given dialogue. Prior work on…
Conversational SearchRetrievalSentenceSentence RetrievalOpen-Retrieval Conversational Machine Reading
In conversational machine reading, systems need to interpret natural language rules, answer high-level questions such as "May I qualify for VA health care benefits?", and ask follow-up clarification questions whose answe…
Discourse SegmentationReading ComprehensionRetrievalOpen-Domain Conversational Question Answering with Historical Answers
Open-domain conversational question answering can be viewed as two tasks: passage retrieval and conversational question answering, where the former relies on selecting candidate passages from a large corpus and the latte…
Conversational Question AnsweringPassage RetrievalQuestion AnsweringRetrievalLatent Retrieval for Weakly Supervised Open Domain Question Answering
Recent work on open domain question answering (QA) assumes strong supervision of the supporting evidence and/or assumes a blackbox information retrieval (IR) system to retrieve evidence candidates. We argue that both are…
Information RetrievalOpen-Domain Question AnsweringQuestion AnsweringRetrievalOpen-Retrieval Conversational Question Answering
Conversational search is one of the ultimate goals of information retrieval. Recent research approaches conversational search by simplified settings of response ranking and conversational question answering, where an ans…
Conversational Question AnsweringConversational SearchInformation RetrievalQuestion Answering+1