End-to-End Continuous Speech Emotion Recognition in Real-life Customer Service Call Center Conversations
Speech Emotion recognition (SER) in call center conversations has emerged as a valuable tool for assessing the quality of interactions between clients and agents. In contrast to controlled laboratory environments, real-life conversations take place under uncontrolled conditions and are subject to contextual factors that influence the expression of emotions. In this paper, we present our approach to constructing a large-scale reallife dataset (CusEmo) for continuous SER in customer service call center conversations. We adopted the dimensional emotion annotation approach to capture the subtlety, complexity, and continuity of emotions in real-life call center conversations, while annotating contextual information. The study also addresses the challenges encountered during the application of the End-to-End (E2E) SER system to the dataset, including determining the appropriate label sampling rate and input segment length, as well as integrating contextual information (interlocutor's gender and empathy level) with different weights using multitask learning. The result shows that incorporating the empathy level information improved the model's performance.
Code (0)
등록된 구현이 없습니다.
Tasks
Emotion RecognitionSpeech Emotion RecognitionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
EMOVOME: A Dataset for Emotion Recognition in Spontaneous Real-Life Speech
Spontaneous datasets for Speech Emotion Recognition (SER) are scarce and frequently derived from laboratory environments or staged scenarios, such as TV shows, limiting their application in real-world contexts. We develo…
Emotion RecognitionFairnessSpeech Emotion RecognitionEnd-to-End Speech Emotion Recognition: Challenges of Real-Life Emergency Call Centers Data Recordings
Recognizing a speaker's emotion from their speech can be a key element in emergency call centers. End-to-end deep learning systems for speech emotion recognition now achieve equivalent or even better results than convent…
Deep LearningEmotion RecognitionSpeech Emotion RecognitionResearch on several key technologies in practical speech emotion recognition
In this dissertation the practical speech emotion recognition technology is studied, including several cognitive related emotion types, namely fidgetiness, confidence and tiredness. The high quality of naturalistic emoti…
ClusteringEmotion RecognitionSpeech Emotion RecognitionSpeech Emotion Diarization: Which Emotion Appears When?
Speech Emotion Recognition (SER) typically relies on utterance-level solutions. However, emotions conveyed through speech should be considered as discrete speech events with definite temporal boundaries, rather than attr…
Emotion Recognitionspeaker-diarizationSpeaker DiarizationSpeech Emotion RecognitionExploring Attention Mechanisms for Multimodal Emotion Recognition in an Emergency Call Center Corpus
The emotion detection technology to enhance human decision-making is an important research issue for real-world applications, but real-life emotion datasets are relatively rare and small. The experiments conducted in thi…
Decision MakingEmotion RecognitionMultimodal Emotion RecognitionSpeech Emotion Recognition