DialDoc 2021 Shared Task: Goal-Oriented Document-grounded Dialogue Modeling
We present the results of Shared Task at Workshop DialDoc 2021 that is focused on document-grounded dialogue and conversational question answering. The primary goal of this Shared Task is to build goal-oriented information-seeking conversation systems that can identify the most relevant knowledge in the associated document for generating agent responses in natural language. It includes two subtasks on predicting agent responses: the first subtask is to predict the grounding text span in the given document for next agent response; the second subtask is to generate agent response in natural language given the context. Many submissions outperform baseline significantly. For the first task, the best-performing system achieved 67.1 Exact Match and 76.3 F1. For the second subtask, the best system achieved 41.1 SacreBLEU and highest rank by human evaluation.
Code (0)
등록된 구현이 없습니다.
Tasks
Conversational Question AnsweringQuestion AnsweringSimilar Papers 제목 키워드 기반
DialDoc 2022 Shared Task: Open-Book Document-grounded Dialogue Modeling
The paper presents the results of the Shared Task hosted by the Second DialDoc Workshop on Document-grounded Dialogue and Conversational Question Answering co-located at ACL 2022. The primary goal of this Shared Task is …
Conversational Question AnsweringQuestion AnsweringCascaded Span Extraction and Response Generation for Document-Grounded Dialog
This paper summarizes our entries to both subtasks of the first DialDoc shared task which focuses on the agent response prediction task in goal-oriented document-grounded dialogs. The task is split into two subtasks: pre…
Response GenerationvalidR3 : Refined Retriever-Reader pipeline for Multidoc2dial
In this paper, we present our submission to the DialDoc shared task based on the MultiDoc2Dial dataset. MultiDoc2Dial is a conversational question answering dataset that grounds dialogues in multiple documents. The task …
Conversational Question AnsweringDecoderPassage RetrievalQuestion Answering+2Document-Grounded Goal-Oriented Dialogue Systems on Pre-Trained Language Model with Diverse Input Representation
Document-grounded goal-oriented dialog system understands users’ utterances, and generates proper responses by using information obtained from documents. The Dialdoc21 shared task consists of two subtasks; subtask1, find…
Goal-Oriented DialogGoal-Oriented Dialogue SystemsLanguage ModelingLanguage Modelling+1Technical Report on Shared Task in DialDoc21
We participate in the DialDoc Shared Task sub-task 1 (Knowledge Identification). The task requires identifying the grounding knowledge in form of a document span for the next dialogue turn. We employ two well-known pre-t…
Data Augmentation