paper-with-me

홈 › Papers

Improving Speaker-independent Speech Emotion Recognition Using Dynamic Joint Distribution Adaptation

2024-01-18 · Cheng Lu, Yuan Zong, Hailun Lian, Yan Zhao, Björn Schuller, Wenming Zheng

In speaker-independent speech emotion recognition, the training and testing samples are collected from diverse speakers, leading to a multi-domain shift challenge across the feature distributions of data from different speakers. Consequently, when the trained model is confronted with data from new speakers, its performance tends to degrade. To address the issue, we propose a Dynamic Joint Distribution Adaptation (DJDA) method under the framework of multi-source domain adaptation. DJDA firstly utilizes joint distribution adaptation (JDA), involving marginal distribution adaptation (MDA) and conditional distribution adaptation (CDA), to more precisely measure the multi-domain distribution shifts caused by different speakers. This helps eliminate speaker bias in emotion features, allowing for learning discriminative and speaker-invariant speech emotion features from coarse-level to fine-level. Furthermore, we quantify the adaptation contributions of MDA and CDA within JDA by using a dynamic balance factor based on $\mathcal{A}$-Distance, promoting to effectively handle the unknown distributions encountered in data from new speakers. Experimental results demonstrate the superior performance of our DJDA as compared to other state-of-the-art (SOTA) methods.

📄 PDF Abstract BibTeX arXiv:2401.09752

Code (0)

등록된 구현이 없습니다.

Tasks

Domain AdaptationEmotion RecognitionSpeech Emotion Recognition

Similar Papers 제목 키워드 기반

Effect of different splitting criteria on the performance of speech emotion recognition

2022-10-26 · Bagus Tris Atmaja, Akira Sasou

Traditional speech emotion recognition (SER) evaluations have been performed merely on a speaker-independent condition; some of them even did not evaluate their result on this condition. This paper highlights the importa…

Emotion RecognitionSentenceSpeech Emotion Recognition

Dual-Scale State-Space Modeling with Speaker-Wise Dynamic CRF for Speech Emotion Recognition in Conversation

2026-08-23 · Guan-Hua Wen, Hou-Chiang Tseng, Kuan-Yu Chen arxiv

Conversational speech emotion recognition must reconcile acoustic evidence across temporal scales with two interaction processes: cross-speaker contextual influence and within-speaker emotion evolution. We propose DSSM-C…

Speech Emotion Recognition

Speaker Normalization for Self-supervised Speech Emotion Recognition

2022-02-02 · Itai Gat, Hagai Aronowitz, Weizhong Zhu, Edmilson Morais 외

Large speech emotion recognition datasets are hard to obtain, and small datasets may contain biases. Deep-net-based classifiers, in turn, are prone to exploit those biases and find shortcuts such as speaker characteristi…

Emotion RecognitionSpeech Emotion Recognition

A Case Study on the Independence of Speech Emotion Recognition in Bangla and English Languages using Language-Independent Prosodic Features

2021-11-21 · Fardin Saad, Hasan Mahmud, Mohammad Ridwan Kabir, Md. Alamin Shaheen 외

A language agnostic approach to recognizing emotions from speech remains an incomplete and challenging task. In this paper, we performed a step-by-step comparative analysis of Speech Emotion Recognition (SER) using Bangl…

Emotion RecognitionSpeech Emotion Recognition

A Fine-tuned Wav2vec 2.0/HuBERT Benchmark For Speech Emotion Recognition, Speaker Verification and Spoken Language Understanding

2021-11-04 · Yingzhi Wang, Abdelmoumene Boumadane, Abdelwahab Heba

Speech self-supervised models such as wav2vec 2.0 and HuBERT are making revolutionary progress in Automatic Speech Recognition (ASR). However, they have not been totally proven to produce better performance on tasks othe…

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Emotion Recognitionintent-classification+8