QuAC : Question Answering in Context
We present QuAC, a dataset for Question Answering in Context that contains 14K information-seeking QA dialogs (100K questions in total). The dialogs involve two crowd workers: (1) a student who poses a sequence of freeform questions to learn as much as possible about a hidden Wikipedia text, and (2) a teacher who answers the questions by providing short excerpts from the text. QuAC introduces challenges not found in existing machine comprehension datasets: its questions are often more open-ended, unanswerable, or only meaningful within the dialog context, as we show in a detailed qualitative evaluation. We also report results for a number of reference models, including a recently state-of-the-art reading comprehension architecture extended to model dialog context. Our best model underperforms humans by 20 F1, suggesting that there is significant room for future work on this data. Dataset, baseline, and leaderboard available at http://quac.ai.
Code (0)
등록된 구현이 없습니다.
Tasks
Question AnsweringReading ComprehensionSimilar Papers 제목 키워드 기반
QuAC: Question Answering in Context
We present QuAC, a dataset for Question Answering in Context that contains 14K information-seeking QA dialogs (100K questions in total). The dialogs involve two crowd workers: (1) a student who poses a sequence of freefo…
Question AnsweringReading ComprehensionAn Empirical Study of Content Understanding in Conversational Question Answering
With a lot of work about context-free question answering systems, there is an emerging trend of conversational question answering models in the natural language processing field. Thanks to the recently collected datasets…
Conversational Question AnsweringQuestion AnsweringCan You Unpack That? Learning to Rewrite Questions-in-Context
Question answering is an AI-complete problem, but existing datasets lack key elements of language understanding such as coreference and ellipsis resolution. We consider sequential question answering: multiple questions a…
Question AnsweringOpen-Domain Conversational Question Answering with Historical Answers
Open-domain conversational question answering can be viewed as two tasks: passage retrieval and conversational question answering, where the former relies on selecting candidate passages from a large corpus and the latte…
Conversational Question AnsweringPassage RetrievalQuestion AnsweringRetrievalQuestion Rewriting for Conversational Question Answering
Conversational question answering (QA) requires the ability to correctly interpret a question in the context of previous conversation turns. We address the conversational QA task by decomposing it into question rewriting…
Conversational Question AnsweringPassage RetrievalQuestion AnsweringQuestion Rewriting+1