Multiple Text Style Transfer by using Word-level Conditional Generative Adversarial Network with Two-Phase Training
The objective of non-parallel text style transfer, or controllable text generation, is to alter specific attributes (e.g. sentiment, mood, tense, politeness, etc) of a given text while preserving its remaining attributes and content. Generative adversarial network (GAN) is a popular model to ensure the transferred sentences are realistic and have the desired target styles. However, training GAN often suffers from mode collapse problem, which causes that the transferred text is little related to the original text. In this paper, we propose a new GAN model with a word-level conditional architecture and a two-phase training procedure. By using a style-related condition architecture before generating a word, our model is able to maintain style-unrelated words while changing the others. By separating the training procedure into reconstruction and transfer phases, our model is able to learn a proper text generation process, which further improves the content preservation. We test our model on polarity sentiment transfer and multiple-attribute transfer tasks. The empirical results show that our model achieves comparable evaluation scores in both transfer accuracy and fluency but significantly outperforms other state-of-the-art models in content compatibility on three real-world datasets.
Code (0)
등록된 구현이 없습니다.
Tasks
AttributeGenerative Adversarial NetworkStyle TransferText GenerationText Style TransferMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
NAST: A Non-Autoregressive Generator with Word Alignment for Unsupervised Text Style Transfer
Autoregressive models have been widely used in unsupervised text style transfer. Despite their success, these models still suffer from the content preservation problem that they usually ignore part of the source sentence…
SentenceStyle TransferText Style TransferUnsupervised Text Style Transfer+1Exploring Contextual Word-level Style Relevance for Unsupervised Style Transfer
Unsupervised style transfer aims to change the style of an input sentence while preserving its original content without using parallel training data. In current dominant approaches, owing to the lack of fine-grained cont…
DecoderDenoisingSentenceStyle TransferPrompt-Based Editing for Text Style Transfer
Prompting approaches have been recently explored in text style transfer, where a textual prompt is used to query a pretrained language model to generate style-transferred texts word by word in an autoregressive manner. H…
ClassificationLanguage ModelingLanguage ModellingStyle Transfer+1Low-Level Linguistic Controls for Style Transfer and Content Preservation
Despite the success of style transfer in image processing, it has seen limited progress in natural language generation. Part of the problem is that content is not as easily decoupled from style in the text domain. Curiou…
DecoderStyle TransferText GenerationLow Level Linguistic Controls for Style Transfer and Content Preservation
Despite the success of style transfer in image processing, it has seen limited progress in natural language generation. Part of the problem is that content is not as easily decoupled from style in the text domain. Curiou…
DecoderStyle TransferText Generation