paper-with-me

홈 › Papers

ET-GAN: Cross-Language Emotion Transfer Based on Cycle-Consistent Generative Adversarial Networks

2019-05-27 · Xiaoqi Jia, Jianwei Tai, Hang Zhou, Yakai Li, Weijuan Zhang, Haichao Du, Qingjia Huang

Despite the remarkable progress made in synthesizing emotional speech from text, it is still challenging to provide emotion information to existing speech segments. Previous methods mainly rely on parallel data, and few works have studied the generalization ability for one model to transfer emotion information across different languages. To cope with such problems, we propose an emotion transfer system named ET-GAN, for learning language-independent emotion transfer from one emotion to another without parallel training samples. Based on cycle-consistent generative adversarial network, our method ensures the transfer of only emotion information across speeches with simple loss designs. Besides, we introduce an approach for migrating emotion information across different languages by using transfer learning. The experiment results show that our method can efficiently generate high-quality emotional speech for any given emotion category, without aligned speech pairs.

📄 PDF Abstract BibTeX arXiv:1905.11173

Code (0)

등록된 구현이 없습니다.

Tasks

Domain AdaptationGenerative Adversarial NetworkSpeech SynthesisTransfer Learning

Similar Papers 제목 키워드 기반

Multi-Reference Neural TTS Stylization with Adversarial Cycle Consistency

2019-10-25 · Matt Whitehill, Shuang Ma, Daniel McDuff, Yale Song

Current multi-reference style transfer models for Text-to-Speech (TTS) perform sub-optimally on disjoints datasets, where one dataset contains only a single style class for one of the style dimensions. These models gener…

Emotion ClassificationStyle Transfertext-to-speechText to Speech

Emotional Semantics-Preserved and Feature-Aligned CycleGAN for Visual Emotion Adaptation

2020-11-25 · Sicheng Zhao, Xuanbai Chen, Xiangyu Yue, Chuang Lin 외

Thanks to large-scale labeled training data, deep neural networks (DNNs) have obtained remarkable success in many vision and multimedia tasks. However, because of the presence of domain shift, the learned knowledge of th…

Domain AdaptationEmotion ClassificationEmotion RecognitionUnsupervised Domain Adaptation

2CET-GAN: Pixel-Level GAN Model for Human Facial Expression Transfer

2022-11-18 · Xiaohang Hu, Nuha Aldausari, Gelareh Mohammadi

Recent studies have used GAN to transfer expressions between human faces. However, existing models have many flaws: relying on emotion labels, lacking continuous expressions, and failing to capture the expression details…

Towards Transferable Speech Emotion Representation: On loss functions for cross-lingual latent representations

2022-03-28 · Sneha Das, Nicole Nadine Lønfeldt, Anne Katrine Pagsberg, Line H. Clemmensen

In recent years, speech emotion recognition (SER) has been used in wide ranging applications, from healthcare to the commercial sector. In addition to signal processing approaches, methods for SER now also use deep learn…

ClassificationDenoisingEmotion ClassificationEmotion Recognition+2

Emotion Classification in Low and Moderate Resource Languages

2024-02-28 · Shabnam Tafreshi, Shubham Vatsal, Mona Diab

It is important to be able to analyze the emotional state of people around the globe. There are 7100+ active languages spoken around the world and building emotion classification for each language is labor intensive. Par…

ClassificationCross-Lingual TransferEmotion ClassificationTransfer Learning