paper-with-me

홈 › Papers

EMOVIE: A Mandarin Emotion Speech Dataset with a Simple Emotional Text-to-Speech Model

2021-06-17 · Chenye Cui, Yi Ren, Jinglin Liu, Feiyang Chen, Rongjie Huang, Ming Lei, Zhou Zhao

Recently, there has been an increasing interest in neural speech synthesis. While the deep neural network achieves the state-of-the-art result in text-to-speech (TTS) tasks, how to generate a more emotional and more expressive speech is becoming a new challenge to researchers due to the scarcity of high-quality emotion speech dataset and the lack of advanced emotional TTS model. In this paper, we first briefly introduce and publicly release a Mandarin emotion speech dataset including 9,724 samples with audio files and its emotion human-labeled annotation. After that, we propose a simple but efficient architecture for emotional speech synthesis called EMSpeech. Unlike those models which need additional reference audio as input, our model could predict emotion labels just from the input text and generate more expressive speech conditioned on the emotion embedding. In the experiment phase, we first validate the effectiveness of our dataset by an emotion classification task. Then we train our model on the proposed dataset and conduct a series of subjective evaluations. Finally, by showing a comparable performance in the emotional speech synthesis task, we successfully demonstrate the ability of the proposed model.

📄 PDF Abstract BibTeX arXiv:2106.09317

Code (0)

등록된 구현이 없습니다.

Tasks

Emotional Speech SynthesisEmotion ClassificationSpeech Synthesistext-to-speechText to Speech

Similar Papers 제목 키워드 기반

SpeechEQ: Speech Emotion Recognition based on Multi-scale Unified Datasets and Multitask Learning

2022-06-27 · Zuheng Kang, Junqing Peng, Jianzong Wang, Jing Xiao

Speech emotion recognition (SER) has many challenges, but one of the main challenges is that each framework does not have a unified standard. In this paper, we propose SpeechEQ, a framework for unifying SER tasks based o…

Emotion RecognitionPhoneme RecognitionSpeech Emotion Recognition

Cross-Lingual Cross-Age Group Adaptation for Low-Resource Elderly Speech Emotion Recognition

2023-06-26 · Samuel Cahyawijaya, Holy Lovenia, Willy Chung, Rita Frieske 외

Speech emotion recognition plays a crucial role in human-computer interactions. However, most speech emotion recognition research is biased toward English-speaking adults, which hinders its applicability to other demogra…

Data AugmentationEmotion RecognitionSpeech Emotion Recognition

ToxicTone: A Mandarin Audio Dataset Annotated for Toxicity and Toxic Utterance Tonality

2025-05-21 · Yu-Xiang Luo, Yi-Cheng Lin, Ming-To Chuang, Jia-Hung Chen 외

Despite extensive research on toxic speech detection in text, a critical gap remains in handling spoken Mandarin audio. The lack of annotated datasets that capture the unique prosodic cues and culturally specific express…

Construction and Evaluation of Mandarin Multimodal Emotional Speech Database

2024-01-14 · Zhu Ting, Li Liangqi, Duan Shufei, Zhang Xueying 외

A multi-modal emotional speech Mandarin database including articulatory kinematics, acoustics, glottal and facial micro-expressions is designed and established, which is described in detail from the aspects of corpus des…

Marco-Voice Technical Report

2025-08-04 · Fengping Tian, Chenyang Lyu, Xuanfan Ni, Haoqin Sun 외 arxiv

This paper presents a multifunctional speech synthesis system that integrates voice cloning and emotion control speech synthesis within a unified framework. The goal of this work is to address longstanding challenges in …

Contrastive LearningSpeech Synthesis