SCAI-QReCC Shared Task on Conversational Question Answering
Search-Oriented Conversational AI (SCAI) is an established venue that regularly puts a spotlight upon the recent work advancing the field of conversational search. SCAI'21 was organised as an independent on-line event and featured a shared task on conversational question answering. Since all of the participant teams experimented with answer generation models for this task, we identified evaluation of answer correctness in this settings as the major challenge and a current research gap. Alongside the automatic evaluation, we conducted two crowdsourcing experiments to collect annotations for answer plausibility and faithfulness. As a result of this shared task, the original conversational QA dataset used for evaluation was further extended with alternative correct answers produced by the participant systems.
Code (1)
Tasks
Answer GenerationConversational Question AnsweringConversational SearchQuestion AnsweringSimilar Papers 제목 키워드 기반
Open-Domain Question Answering Goes Conversational via Question Rewriting
We introduce a new dataset for Question Rewriting in Conversational Context (QReCC), which contains 14K conversations with 80K question-answer pairs. The task in QReCC is to find answers to conversational questions withi…
Conversational Question AnsweringOpen-Domain Question AnsweringPassage RetrievalQuestion Answering+3Question rewriting? Assessing its importance for conversational question answering
In conversational question answering, systems must correctly interpret the interconnected interactions and generate knowledgeable answers, which may require the retrieval of relevant information from a background reposit…
Conversational Question AnsweringQuestion AnsweringQuestion RewritingRetrievalSaving Dense Retriever from Shortcut Dependency in Conversational Search
Conversational search (CS) needs a holistic understanding of conversational inputs to retrieve relevant passages. In this paper, we demonstrate the existence of a retrieval shortcut in CS, which causes models to retrieve…
Conversational SearchRetrievalProceedings of the 2018 EMNLP Workshop SCAI: The 2nd International Workshop on Search-Oriented Conversational AI
A Clarifying Question Selection System from NTES_ALONG in Convai3 Challenge
This paper presents the participation of NetEase Game AI Lab team for the ClariQ challenge at Search-oriented Conversational AI (SCAI) EMNLP workshop in 2020. The challenge asks for a complete conversational information …
Information RetrievalQuestion SelectionRetrieval