Test-Time Adaptation for Speech Emotion Recognition
The practical utility of Speech Emotion Recognition (SER) systems is undermined by their fragility to domain shifts, such as speaker variability, the distinction between acted and naturalistic emotions, and cross-corpus variations. While domain adaptation and fine-tuning are widely studied, they require either source data or labelled target data, which are often unavailable or raise privacy concerns in SER. Test-time adaptation (TTA) bridges this gap by adapting models at inference using only unlabeled target data. Yet, having been predominantly designed for image classification and speech recognition, the efficacy of TTA for mitigating the unique domain shifts in SER has not been investigated. In this paper, we present the first systematic evaluation and comparison covering 11 TTA methods across three representative SER tasks. The results indicate that backpropagation-free TTA methods are the most promising. Conversely, entropy minimization and pseudo-labeling generally fail, as their core assumption of a single, confident ground-truth label is incompatible with the inherent ambiguity of emotional expression. Further, no single method universally excels, and its effectiveness is highly dependent on the distributional shifts and tasks.
Code (0)
등록된 구현이 없습니다.
Tasks
Speech Emotion RecognitionTest-time AdaptationImage ClassificationSpeech RecognitionSimilar Papers 제목 키워드 기반
EMO-TTA: Improving Test-Time Adaptation of Audio-Language Models for Speech Emotion Recognition
Speech emotion recognition (SER) with audio-language models (ALMs) remains vulnerable to distribution shifts at test time, leading to performance degradation in out-of-domain scenarios. Test-time adaptation (TTA) provide…
Speech Emotion RecognitionTest-time AdaptationImproving Speaker-independent Speech Emotion Recognition Using Dynamic Joint Distribution Adaptation
In speaker-independent speech emotion recognition, the training and testing samples are collected from diverse speakers, leading to a multi-domain shift challenge across the feature distributions of data from different s…
Domain AdaptationEmotion RecognitionSpeech Emotion RecognitionUnsupervised Personalization of an Emotion Recognition System: The Unique Properties of the Externalization of Valence in Speech
The prediction of valence from speech is an important, but challenging problem. The externalization of valence in speech has speaker-dependent cues, which contribute to performances that are often significantly lower tha…
Emotion RecognitionPredictionSpeech Emotion RecognitionTransfer LearningLearning Transferable Features for Speech Emotion Recognition
Emotion recognition from speech is one of the key steps towards emotional intelligence in advanced human-machine interaction. Identifying emotions in human speech requires learning features that are robust and discrimina…
Domain AdaptationEmotional IntelligenceEmotion RecognitionSpeech Emotion RecognitionTransferable Positive/Negative Speech Emotion Recognition via Class-wise Adversarial Domain Adaptation
Speech emotion recognition plays an important role in building more intelligent and human-like agents. Due to the difficulty of collecting speech emotional data, an increasingly popular solution is leveraging a related a…
Domain AdaptationEmotion RecognitionSpeech Emotion Recognition