Filling Conversation Ellipsis for Better Social Dialog Understanding
The phenomenon of ellipsis is prevalent in social conversations. Ellipsis increases the difficulty of a series of downstream language understanding tasks, such as dialog act prediction and semantic role labeling. We propose to resolve ellipsis through automatic sentence completion to improve language understanding. However, automatic ellipsis completion can result in output which does not accurately reflect user intent. To address this issue, we propose a method which considers both the original utterance that has ellipsis and the automatically completed utterance in dialog act and semantic role labeling tasks. Specifically, we first complete user utterances to resolve ellipsis using an end-to-end pointer network model. We then train a prediction model using both utterances containing ellipsis and our automatically completed utterances. Finally, we combine the prediction results from these two utterances using a selection model that is guided by expert knowledge. Our approach improves dialog act prediction and semantic role labeling by 1.3% and 2.5% in F1 score respectively in social conversations. We also present an open-domain human-machine conversation dataset with manually completed user utterances and annotated semantic role labeling after manual completion.
Code (0)
등록된 구현이 없습니다.
Tasks
PredictionSemantic Role LabelingSentenceSentence CompletionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
RiSAWOZ: A Large-Scale Multi-Domain Wizard-of-Oz Dataset with Rich Semantic Annotations for Task-Oriented Dialogue Modeling
In order to alleviate the shortage of multi-domain data and to capture discourse phenomena for task-oriented dialogue modeling, we propose RiSAWOZ, a large-scale multi-domain Chinese Wizard-of-Oz dataset with Rich Semant…
Dialogue State TrackingIntent DetectionNatural Language Understandingslot-filling+2Active Learning and Multi-label Classification for Ellipsis and Coreference Detection in Conversational Question-Answering
In human conversations, ellipsis and coreference are commonly occurring linguistic phenomena. Although these phenomena are a mean of making human-machine conversations more fluent and natural, only few dialogue corpora c…
Active LearningConversational Question AnsweringMulti-Label ClassificationMUlTI-LABEL-ClASSIFICATION+1Spoken Conversational Search for General Knowledge
We present a spoken conversational question answering proof of concept that is able to answer questions about general knowledge from Wikidata. The dialogue component does not only orchestrate various components but also …
Conversational Question AnsweringConversational SearchGeneral KnowledgeQuestion AnsweringExtracting triples from dialogues for conversational social agents
Obtaining an explicit understanding of communication within a Hybrid Intelligence collaboration is essential to create controllable and transparent agents. In this paper, we describe a number of Natural Language Understa…
Knowledge Base CompletionNatural Language UnderstandingNegationDialogSum: A Real-Life Scenario Dialogue Summarization Dataset
Proposal of large-scale datasets has facilitated research on deep neural models for news summarization. Deep learning can also be potentially useful for spoken dialogue summarization, which can benefit a range of real-li…
Abstractive Dialogue SummarizationCommon Sense ReasoningManagementRepresentation Learning+1