Real-time Caller Intent Detection In Human-Human Customer Support Spoken Conversations
Agent assistance during human-human customer support spoken interactions requires triggering workflows based on the caller's intent (reason for call). Timeliness of prediction is essential for a good user experience. The goal is for a system to detect the caller's intent at the time the agent would have been able to detect it (Intent Boundary). Some approaches focus on predicting the output offline, i.e. once the full spoken input (e.g. the whole conversational turn) has been processed by the ASR system. This introduces an undesirable latency in the prediction each time the intent could have been detected earlier in the turn. Recent work on voice assistants has used incremental real-time predictions at a word-by-word level to detect intent before the end of a command. Human-directed and machine-directed speech however have very different characteristics. In this work, we propose to apply a method developed in the context of voice-assistant to the problem of online real time caller's intent detection in human-human spoken interactions. We use a dual architecture in which two LSTMs are jointly trained: one predicting the Intent Boundary (IB) and then other predicting the intent class at the IB. We conduct our experiments on our private dataset comprising transcripts of human-human telephone conversations from the telecom customer support domain. We report results analyzing both the accuracy of our system as well as the impact of different architectures on the trade off between overall accuracy and prediction latency.
Code (0)
등록된 구현이 없습니다.
Tasks
Intent DetectionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Can Self-Supervised Neural Representations Pre-Trained on Human Speech distinguish Animal Callers?
Self-supervised learning (SSL) models use only the intrinsic structure of a given signal, independent of its acoustic domain, to extract essential information from the input to an embedding space. This implies that the u…
Caller DetectionSelf-Supervised LearningSpeaker RecognitionHarperValleyBank: A Domain-Specific Spoken Dialog Corpus
We introduce HarperValleyBank, a free, public domain spoken dialog corpus. The data simulate simple consumer banking interactions, containing about 23 hours of audio from 1,446 human-human conversations between 59 unique…
Representation LearningSpecificityHELPS for Emergency Location Service: Hyper-Enhanced Local Positioning System
In this study, we propose a novel positioning and searching system for emergency location services, namely the hyper-enhanced local positioning system (HELPS), which is applicable to all mobile phone users, including leg…
Advanced Real-Time Fraud Detection Using RAG-Based LLMs
Artificial Intelligence has become a double edged sword in modern society being both a boon and a bane. While it empowers individuals it also enables malicious actors to perpetrate scams such as fraudulent phone calls an…
Fraud DetectionRAGRetrieval-augmented GenerationA Recurrent Neural Network Approach to the Answering Machine Detection Problem
In the field of telecommunications and cloud communications, accurately and in real-time detecting whether a human or an answering machine has answered an outbound call is of paramount importance. This problem is of part…
Transfer Learning