ET-GAN: Cross-Language Emotion Transfer Based on Cycle-Consistent Generative Adversarial Networks
Despite the remarkable progress made in synthesizing emotional speech from text, it is still challenging to provide emotion information to existing speech segments. Previous methods mainly rely on parallel data, and few works have studied the generalization ability for one model to transfer emotion information across different languages. To cope with such problems, we propose an emotion transfer system named ET-GAN, for learning language-independent emotion transfer from one emotion to another without parallel training samples. Based on cycle-consistent generative adversarial network, our method ensures the transfer of only emotion information across speeches with simple loss designs. Besides, we introduce an approach for migrating emotion information across different languages by using transfer learning. The experiment results show that our method can efficiently generate high-quality emotional speech for any given emotion category, without aligned speech pairs.
Code (0)
등록된 구현이 없습니다.
Tasks
Domain AdaptationGenerative Adversarial NetworkSpeech SynthesisTransfer LearningSimilar Papers 제목 키워드 기반
Multi-Reference Neural TTS Stylization with Adversarial Cycle Consistency
Current multi-reference style transfer models for Text-to-Speech (TTS) perform sub-optimally on disjoints datasets, where one dataset contains only a single style class for one of the style dimensions. These models gener…
Emotion ClassificationStyle Transfertext-to-speechText to SpeechEmotional Semantics-Preserved and Feature-Aligned CycleGAN for Visual Emotion Adaptation
Thanks to large-scale labeled training data, deep neural networks (DNNs) have obtained remarkable success in many vision and multimedia tasks. However, because of the presence of domain shift, the learned knowledge of th…
Domain AdaptationEmotion ClassificationEmotion RecognitionUnsupervised Domain Adaptation2CET-GAN: Pixel-Level GAN Model for Human Facial Expression Transfer
Recent studies have used GAN to transfer expressions between human faces. However, existing models have many flaws: relying on emotion labels, lacking continuous expressions, and failing to capture the expression details…
Towards Transferable Speech Emotion Representation: On loss functions for cross-lingual latent representations
In recent years, speech emotion recognition (SER) has been used in wide ranging applications, from healthcare to the commercial sector. In addition to signal processing approaches, methods for SER now also use deep learn…
ClassificationDenoisingEmotion ClassificationEmotion Recognition+2Emotion Classification in Low and Moderate Resource Languages
It is important to be able to analyze the emotional state of people around the globe. There are 7100+ active languages spoken around the world and building emotion classification for each language is labor intensive. Par…
ClassificationCross-Lingual TransferEmotion ClassificationTransfer Learning