paper-with-me

홈 › Papers

Handling Ambiguity in Emotion: From Out-of-Domain Detection to Distribution Estimation

2024-02-20 · Wen Wu, Bo Li, Chao Zhang, Chung-Cheng Chiu, Qiujia Li, Junwen Bai, Tara N. Sainath, Philip C. Woodland

The subjective perception of emotion leads to inconsistent labels from human annotators. Typically, utterances lacking majority-agreed labels are excluded when training an emotion classifier, which cause problems when encountering ambiguous emotional expressions during testing. This paper investigates three methods to handle ambiguous emotion. First, we show that incorporating utterances without majority-agreed labels as an additional class in the classifier reduces the classification performance of the other emotion classes. Then, we propose detecting utterances with ambiguous emotions as out-of-domain samples by quantifying the uncertainty in emotion classification using evidential deep learning. This approach retains the classification accuracy while effectively detects ambiguous emotion expressions. Furthermore, to obtain fine-grained distinctions among ambiguous emotions, we propose representing emotion as a distribution instead of a single class label. The task is thus re-framed from classification to distribution estimation where every individual annotation is taken into account, not just the majority opinion. The evidential uncertainty measure is extended to quantify the uncertainty in emotion distribution estimation. Experimental results on the IEMOCAP and CREMA-D datasets demonstrate the superior capability of the proposed method in terms of majority class prediction, emotion distribution estimation, and uncertainty estimation.

📄 PDF Abstract BibTeX arXiv:2402.12862

Code (0)

등록된 구현이 없습니다.

Tasks

ClassificationEmotion Classification

Similar Papers 제목 키워드 기반

SHALA-LLM: Smartly Handling Ambiguous Labels in Aligning LLMs

2026-06-03 · Jingyao Wu, Ashley Wang, Keane Ong, Paul Pu Liang 외 arxiv

Many human-centered tasks, including natural language inference (NLI) and emotion recognition (ER), have multiple plausible interpretations, leading to label ambiguity and challenging disagreements across human annotator…

Natural Language InferenceReinforcement LearningEmotion Recognition

Dual-Constrained Dynamical Neural ODEs for Ambiguity-aware Continuous Emotion Prediction

2024-07-31 · Jingyao Wu, Ting Dang, Vidhyasaharan Sethu, Eliathamby Ambikairajah

There has been a significant focus on modelling emotion ambiguity in recent years, with advancements made in representing emotions as distributions to capture ambiguity. However, there has been comparatively less effort …

Time Series

Scaling Ambiguity: Augmenting Human Annotation in Speech Emotion Recognition with Audio-Language Models

2026-01-21 · Wenda Zhang, Hongyu Jin, Siyi Wang, Zhiqiang Wei 외 arxiv

Speech Emotion Recognition models typically use single categorical labels, overlooking the inherent ambiguity of human emotions. Ambiguous Emotion Recognition addresses this by representing emotions as probability distri…

Speech Emotion Recognition

Disentangling Reasoning in Large Audio-Language Models for Ambiguous Emotion Prediction

2026-03-09 · Xiaofeng Yu, Jiaheng Dong, Jean Honorio, Abhirup Ghosh 외 arxiv

Speech emotion recognition plays an important role in various applications. However, most existing approaches predict a single emotion label, oversimplifying the inherently ambiguous nature of human emotional expression.…

Speech Emotion Recognition

READ-Net: Clarifying Emotional Ambiguity via Adaptive Feature Recalibration for Audio-Visual Depression Detection

2026-01-21 · Chenglizhao Chen, Boze Li, Mengke Song, Dehao Feng 외 arxiv

Depression is a severe global mental health issue that impairs daily functioning and overall quality of life. Although recent audio-visual approaches have improved automatic depression detection, methods that ignore emot…