MSSRNet: Manipulating Sequential Style Representation for Unsupervised Text Style Transfer
Unsupervised text style transfer task aims to rewrite a text into target style while preserving its main content. Traditional methods rely on the use of a fixed-sized vector to regulate text style, which is difficult to accurately convey the style strength for each individual token. In fact, each token of a text contains different style intensity and makes different contribution to the overall style. Our proposed method addresses this issue by assigning individual style vector to each token in a text, allowing for fine-grained control and manipulation of the style strength. Additionally, an adversarial training framework integrated with teacher-student learning is introduced to enhance training stability and reduce the complexity of high-dimensional optimization. The results of our experiments demonstrate the efficacy of our method in terms of clearly improved style transfer accuracy and content preservation in both two-style transfer and multi-style transfer settings.
Code (1)
Tasks
Style TransferText Style TransferUnsupervised Text Style TransferSimilar Papers 제목 키워드 기반
DyStyle: Dynamic Neural Network for Multi-Attribute-Conditioned Style Editing
The semantic controllability of StyleGAN is enhanced by unremitting research. Although the existing weak supervision methods work well in manipulating the style codes along one attribute, the accuracy of manipulating mul…
AttributeContrastive LearningUnsupervised Quantized Prosody Representation for Controllable Speech Synthesis
In this paper, we propose a novel prosody disentangle method for prosodic Text-to-Speech (TTS) model, which introduces the vector quantization (VQ) method to the auxiliary prosody encoder to obtain the decomposed prosody…
QuantizationSpeech Synthesistext-to-speechText to SpeechUnsupervised Learning of Disentangled and Interpretable Representations from Sequential Data
We present a factorized hierarchical variational autoencoder, which learns disentangled and interpretable representations from sequential data without supervision. Specifically, we exploit the multi-scale nature of infor…
Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Speaker Verificationspeech-recognition+1Separating Content and Style for Unsupervised Image-to-Image Translation
Unsupervised image-to-image translation aims to learn the mapping between two visual domains with unpaired samples. Existing works focus on disentangling domain-invariant content code and domain-specific style code indiv…
DiversityImage-to-Image TranslationTranslationUnsupervised Image-To-Image TranslationUnsupervised Text Style Transfer with Deep Generative Models
We present a general framework for unsupervised text style transfer with deep generative models. The framework models each sentence-label pair in the non-parallel corpus as partially observed from a complete quadruplet w…
SentenceStyle TransferText Style TransferUnsupervised Text Style Transfer