paper-with-me

Papers

Do Speech Emphasis Models Generalize across Languages and Emotions?

2026-06-26 · Megan Wei, Deepali Aneja, Jiaqi Su, Yunyun Wang, Haonan Chen, Zeyu Jin arxiv

Prosodic emphasis varies across languages, emotions, and speaking styles, yet existing emphasis detection models are largely trained and evaluated on monolingual neutral read speech. We introduce MMEE (Multilingual Multi-Emotion Emphasis), a corpus of 10,000 professionally recorded expressive utterances (14.13 hours) across 7 languages and 34 emotion/style categories, with three-level perceptual labels (10 annotations per sample). We benchmark two state-of-the-art architectures under monolingual, cross-lingual, multilingual, cross-emotion, cross-dataset, and data-scale settings. Monolingual models show limited zero-shot transfer, degrading across typologically distant languages, while multilingual training substantially improves robustness. Models transfer robustly between high- and low-arousal emotions; bidirectional transfer between synthetic and perceptual benchmarks suggests shared prosodic structure; and performance stays robust even at smaller training scales.

📄 PDF Abstract BibTeX arXiv:2606.27717

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

CLARA: Multilingual Contrastive Learning for Audio Representation Acquisition

2023-10-18 · Kari A Noriy, Xiaosong Yang, Marcin Budka, Jian Jun Zhang

Multilingual speech processing requires understanding emotions, a task made difficult by limited labelled data. CLARA, minimizes reliance on labelled data, enhancing generalization across languages. It excels at fosterin…

Audio ClassificationContrastive LearningCross-Lingual TransferData Augmentation+6

A Case Study on the Independence of Speech Emotion Recognition in Bangla and English Languages using Language-Independent Prosodic Features

2021-11-21 · Fardin Saad, Hasan Mahmud, Mohammad Ridwan Kabir, Md. Alamin Shaheen 외

A language agnostic approach to recognizing emotions from speech remains an incomplete and challenging task. In this paper, we performed a step-by-step comparative analysis of Speech Emotion Recognition (SER) using Bangl…

Emotion RecognitionSpeech Emotion Recognition

Rasa: Building Expressive Speech Synthesis Systems for Indian Languages in Low-resource Settings

2024-07-19 · Praveen Srinivasa Varadhan, Ashwin Sankar, Giri Raju, Mitesh M. Khapra

We release Rasa, the first multilingual expressive TTS dataset for any Indian language, which contains 10 hours of neutral speech and 1-3 hours of expressive speech for each of the 6 Ekman emotions covering 3 languages: …

Expressive Speech SynthesisSpeech Synthesis

Decoding Emotions: A comprehensive Multilingual Study of Speech Models for Speech Emotion Recognition

2023-08-17 · Anant Singh, Akshat Gupta

Recent advancements in transformer-based speech representation models have greatly transformed speech processing. However, there has been limited research conducted on evaluating these models for speech emotion recogniti…

Emotion RecognitionSpeech Emotion Recognition

Is Prosody Lost in Translation? Fine-Grained Cross-Lingual Prosody Similarity Across Languages

2026-08-28 · Haopeng Xie, Ismail Rasim Ulgen, Sofia Son, Berrak Sisman 외 arxiv

Prosody plays an important role in speech translation, conveying information such as emphasis, emotion, and intent beyond lexical content. However, despite recent progress in expressive speech-to-speech translation (S2ST…

Speech-to-Speech Translation