paper-with-me

Papers

Multi-Classifier Interactive Learning for Ambiguous Speech Emotion Recognition

2020-12-10 · Ying Zhou, Xuefeng Liang, Yu Gu, Yifei Yin, Longshan Yao

In recent years, speech emotion recognition technology is of great significance in industrial applications such as call centers, social robots and health care. The combination of speech recognition and speech emotion recognition can improve the feedback efficiency and the quality of service. Thus, the speech emotion recognition has been attracted much attention in both industry and academic. Since emotions existing in an entire utterance may have varied probabilities, speech emotion is likely to be ambiguous, which poses great challenges to recognition tasks. However, previous studies commonly assigned a single-label or multi-label to each utterance in certain. Therefore, their algorithms result in low accuracies because of the inappropriate representation. Inspired by the optimally interacting theory, we address the ambiguous speech emotions by proposing a novel multi-classifier interactive learning (MCIL) method. In MCIL, multiple different classifiers first mimic several individuals, who have inconsistent cognitions of ambiguous emotions, and construct new ambiguous labels (the emotion probability distribution). Then, they are retrained with the new labels to interact with their cognitions. This procedure enables each classifier to learn better representations of ambiguous data from others, and further improves the recognition ability. The experiments on three benchmark corpora (MAS, IEMOCAP, and FAU-AIBO) demonstrate that MCIL does not only improve each classifier's performance, but also raises their recognition consistency from moderate to substantial.

📄 PDF Abstract BibTeX arXiv:2012.05429

Code (0)

등록된 구현이 없습니다.

Tasks

Emotion RecognitionSpeech Emotion Recognitionspeech-recognitionSpeech Recognition

Similar Papers 제목 키워드 기반

Curriculum Learning for Speech Emotion Recognition from Crowdsourced Labels

2018-05-25

This study introduces a method to design a curriculum for machine-learning to maximize the efficiency during the training process of deep neural networks (DNNs) for speech emotion recognition. Previous studies in other m…

Emotion RecognitionMulti-class ClassificationSpeech Emotion Recognition

Speech Emotion Recognition with Multiscale Area Attention and Data Augmentation

2021-02-03 · Mingke Xu, Fan Zhang, Xiaodong Cui, Wei zhang

In Speech Emotion Recognition (SER), emotional characteristics often appear in diverse forms of energy patterns in spectrograms. Typical attention neural network classifiers of SER are usually optimized on a fixed attent…

Data AugmentationEmotion RecognitionSpeech Emotion Recognition

Multimodal Speech Emotion Recognition and Ambiguity Resolution

2019-04-12 · Gaurav Sahu

Identifying emotion from speech is a non-trivial task pertaining to the ambiguous definition of emotion itself. In this work, we adopt a feature-engineering based approach to tackle the task of speech emotion recognition…

BIG-bench Machine LearningEmotion RecognitionFeature EngineeringMulti-class Classification+2

Sympatheia: Emotionally Adaptive Voice Assistant with Continuous Affect Conditioning

2026-05-30 · Sukru Samet Dindar, Riki Shimizu, Xilin Jiang, Nima Mesgarani arxiv

Empathetic spoken dialogue systems must infer a user's emotional state to respond appropriately, yet everyday speech often carries weak, neutral, or ambiguous affective cues. To address this, we introduce Sympatheia, a s…

Decoding Ambiguous Emotions with Test-Time Scaling in Audio-Language Models

2026-02-01 · Hong Jia, Weibin Li, Jingyao Wu, Xiaofeng Yu 외 arxiv

Emotion recognition from human speech is a critical enabler for socially aware conversational AI. However, while most prior work frames emotion recognition as a categorical classification problem, real-world affective st…

Emotion Recognition