Addressing Ambiguity of Emotion Labels Through Meta-Learning
Emotion labels in emotion recognition corpora are highly noisy and ambiguous, due to the annotators' subjective perception of emotions. Such ambiguity may introduce errors in automatic classification and affect the overall performance. We therefore propose a dynamic label correction and sample contribution weight estimation model. Our model is based on a standard BLSTM model with attention with two extra parameters. The first learns a new corrected label distribution, and is aimed to fix the inaccurate labels from the dataset. The other instead estimates the contribution of each sample to the training process, and is aimed to ignore the ambiguous and noisy samples while giving higher weight to the clear ones. We train our model through an alternating optimization method, where in the first epoch we update the neural network parameters, and in the second we keep them fixed to update the label correction and sample importance parameters. When training and evaluating our model on the IEMOCAP dataset, we obtained a weighted accuracy (WA) and unweighted accuracy (UA) of respectively 65.9% and 61.4%. This yielded an absolute improvement of 2.5%, 2.7% respectively compared to a BLSTM with attention baseline, trained on the corpus gold labels.
Code (0)
등록된 구현이 없습니다.
Tasks
Emotion RecognitionMeta-LearningSimilar Papers 제목 키워드 기반
Emotions as Ambiguity-aware Ordinal Representations
Emotions are inherently ambiguous and dynamic phenomena, yet existing continuous emotion recognition approaches either ignore their ambiguity or treat ambiguity as an independent and static variable over time. Motivated …
Emotion RecognitionReasoning under Ambiguity: Uncertainty-Aware Multilingual Emotion Classification under Partial Supervision
Contemporary knowledge-based systems increasingly rely on multilingual emotion identification to support intelligent decision-making, yet they face major challenges due to emotional ambiguity and incomplete supervision. …
Emotion ClassificationEmotion RecognitionScaling Ambiguity: Augmenting Human Annotation in Speech Emotion Recognition with Audio-Language Models
Speech Emotion Recognition models typically use single categorical labels, overlooking the inherent ambiguity of human emotions. Ambiguous Emotion Recognition addresses this by representing emotions as probability distri…
Speech Emotion RecognitionDo Multimodal Emotion Recognition Models Tackle Ambiguity?
Most databases used for emotion recognition assign a single emotion to data samples. This does not match with the complex nature of emotions: we can feel a wide range of emotions throughout our lives with varying degrees…
Emotion RecognitionMultimodal Emotion RecognitionSHALA-LLM: Smartly Handling Ambiguous Labels in Aligning LLMs
Many human-centered tasks, including natural language inference (NLI) and emotion recognition (ER), have multiple plausible interpretations, leading to label ambiguity and challenging disagreements across human annotator…
Natural Language InferenceReinforcement LearningEmotion Recognition