Offline and Online Satisfaction Prediction in Open-Domain Conversational Systems

2020-06-02 · Jason Ingyu Choi, Ali Ahmadvand, Eugene Agichtein

Predicting user satisfaction in conversational systems has become critical, as spoken conversational assistants operate in increasingly complex domains. Online satisfaction prediction (i.e., predicting satisfaction of the user with the system after each turn) could be used as a new proxy for implicit user feedback, and offers promising opportunities to create more responsive and effective conversational agents, which adapt to the user's engagement with the agent. To accomplish this goal, we propose a conversational satisfaction prediction model specifically designed for open-domain spoken conversational agents, called ConvSAT. To operate robustly across domains, ConvSAT aggregates multiple representations of the conversation, namely the conversation history, utterance and response content, and system- and user-oriented behavioral signals. We first calibrate ConvSAT performance against state of the art methods on a standard dataset (Dialogue Breakdown Detection Challenge) in an online regime, and then evaluate ConvSAT on a large dataset of conversations with real users, collected as part of the Alexa Prize competition. Our experimental results show that ConvSAT significantly improves satisfaction prediction for both offline and online setting on both datasets, compared to the previously reported state-of-the-art approaches. The insights from our study can enable more intelligent conversational systems, which could adapt in real-time to the inferred user satisfaction and engagement.

📄 PDF Abstract BibTeX arXiv:2006.01921

Code (1)

emory-irlab/ConvSAT 공식 구현

Multi-Task Fusion via Reinforcement Learning for Long-Term User Satisfaction in Recommender Systems

2022-08-09 · Qihua Zhang, Junning Liu, Yuzhuo Dai, Yiyan Qi 외

Recommender System (RS) is an important online application that affects billions of users every day. The mainstream RS ranking framework is composed of two parts: a Multi-Task Learning model (MTL) that predicts various u…

Multi-Task Learning Recommendation Systems Reinforcement Learning (RL)

Safe Chance Constrained Reinforcement Learning for Batch Process Control

2021-04-23 · Max Mowbray, Panagiotis Petsagkourakis, Ehecatl Antonio del Río Chanona, Dongda Zhang

Reinforcement Learning (RL) controllers have generated excitement within the control community. The primary advantage of RL controllers relative to existing methods is their ability to optimize uncertain systems independ…

Gaussian Processes Model Predictive Control reinforcement-learning Reinforcement Learning+1

TIP-Search: Time-Predictable Inference Scheduling for Market Prediction under Uncertain Load

2025-05-30 · Xibai Wang

This paper proposes TIP-Search, a time-predictable inference scheduling framework for real-time market prediction under uncertain workloads. Motivated by the strict latency demands in high-frequency financial systems, TI…

Scheduling

Automatic Music Playlist Generation via Simulation-based Reinforcement Learning

2023-10-13 · Federico Tomasi, Joseph Cauteruccio, Surya Kanoria, Kamil Ciosek 외

Personalization of playlists is a common feature in music streaming services, but conventional techniques, such as collaborative filtering, rely on explicit assumptions regarding content quality to learn how to make reco…

Collaborative Filtering reinforcement-learning Reinforcement Learning

UME: A Unified Meta-Generalization Framework for Cross-Domain ETA

2026-05-31 · Duo Wang, Qiong Wu, Jianguo Wu, Ruiyu Xu 외 arxiv

Accurate Estimated Time of Arrival (ETA) prediction on checkout page is crucial in instant logistics for enhancing user satisfaction, optimizing dispatching, and controlling operational costs. In international on-demand …

Knowledge Distillation Domain Adaptation