Improving Interaction Quality Estimation with BiLSTMs and the Impact on Dialogue Policy Learning
Learning suitable and well-performing dialogue behaviour in statistical spoken dialogue systems has been in the focus of research for many years. While most work which is based on reinforcement learning employs an objective measure like task success for modelling the reward signal, we use a reward based on user satisfaction estimation. We propose a novel estimator and show that it outperforms all previous estimators while learning temporal dependencies implicitly. Furthermore, we apply this novel user satisfaction estimation model live in simulated experiments where the satisfaction estimation model is trained on one domain and applied in many other domains which cover a similar task. We show that applying this model results in higher estimated satisfaction, similar task success rates and a higher robustness to noise.
Code (0)
등록된 구현이 없습니다.
Tasks
Reinforcement LearningReinforcement Learning (RL)Spoken Dialogue SystemsSimilar Papers 제목 키워드 기반
CoAStaL at SemEval-2019 Task 3: Affect Classification in Dialogue using Attentive BiLSTMs
This work describes the system presented by the CoAStaL Natural Language Processing group at University of Copenhagen. The main system we present uses the same attention mechanism presented in (Yang et al., 2016). Our ov…
General ClassificationWhat Went Wrong? Explaining Overall Dialogue Quality through Utterance-Level Impacts
Improving user experience of a dialogue system often requires intensive developer effort to read conversation logs, run statistical analyses, and intuit the relative importance of system shortcomings. This paper presents…
ChatbotWeakly-supervised LearningInteraction Quality Estimation in Spoken Dialogue Systems Using Hybrid-HMMs
Bridging Cultural Nuances in Dialogue Agents through Cultural Value Surveys
The cultural landscape of interactions with dialogue agents is a compelling yet relatively unexplored territory. It's clear that various sociocultural aspects -- from communication styles and beliefs to shared metaphors …
Dialogue GenerationInteraction Quality Estimation Using Long Short-Term Memories
For estimating the Interaction Quality (IQ) in Spoken Dialogue Systems (SDS), the dialogue history is of significant importance. Previous works included this information manually in the form of precomputed temporal featu…
General ClassificationSpoken Dialogue Systems