Context-Aware Dialog Re-Ranking for Task-Oriented Dialog Systems
Dialog response ranking is used to rank response candidates by considering their relation to the dialog history. Although researchers have addressed this concept for open-domain dialogs, little attention has been focused on task-oriented dialogs. Furthermore, no previous studies have analyzed whether response ranking can improve the performance of existing dialog systems in real human-computer dialogs with speech recognition errors. In this paper, we propose a context-aware dialog response re-ranking system. Our system reranks responses in two steps: (1) it calculates matching scores for each candidate response and the current dialog context; (2) it combines the matching scores and a probability distribution of the candidates from an existing dialog system for response re-ranking. By using neural word embedding-based models and handcrafted or logistic regression-based ensemble models, we have improved the performance of a recently proposed end-to-end task-oriented dialog system on real dialogs with speech recognition errors.
Code (1)
Tasks
Re-Rankingspeech-recognitionSpeech RecognitionSimilar Papers 제목 키워드 기반
Contextual Data Augmentation for Task-Oriented Dialog Systems
Collection of annotated dialogs for training task-oriented dialog systems have been one of the key bottlenecks in improving current models. While dialog response generation has been widely studied on the agent side, it i…
Data AugmentationLanguage ModelingLanguage ModellingParaphrase Generation+2FCC: Fusing Conversation History and Candidate Provenance for Contextual Response Ranking in Dialogue Systems
Response ranking in dialogues plays a crucial role in retrieval-based conversational systems. In a multi-turn dialogue, to capture the gist of a conversation, contextual information serves as essential knowledge to achie…
MiscellaneousRetrievalTask-Oriented Clustering for Dialogues
A reliable clustering algorithm for task-oriented dialogues can help developer analysis and define dialogue tasks efficiently. It is challenging to directly apply prior normal text clustering algorithms for task-oriented…
ClusteringDiversityRepresentation LearningText ClusteringContext-Aware Language Modeling for Goal-Oriented Dialogue Systems
Goal-oriented dialogue systems face a trade-off between fluent language generation and task-specific control. While supervised learning with large language models is capable of producing realistic text, how to steer such…
Goal-Oriented Dialogue SystemsLanguage ModelingLanguage ModellingOpen-Ended Question Answering+1Topic-Aware Response Generation in Task-Oriented Dialogue with Unstructured Knowledge Access
To alleviate the problem of structured databases' limited coverage, recent task-oriented dialogue systems incorporate external unstructured knowledge to guide the generation of system responses. However, these usually us…
Response GenerationSentenceTask-Oriented Dialogue Systems