Enhancing Content Preservation in Text Style Transfer Using Reverse Attention and Conditional Layer Normalization
Text style transfer aims to alter the style (e.g., sentiment) of a sentence while preserving its content. A common approach is to map a given sentence to content representation that is free of style, and the content representation is fed to a decoder with a target style. Previous methods in filtering style completely remove tokens with style at the token level, which incurs the loss of content information. In this paper, we propose to enhance content preservation by implicitly removing the style information of each token with reverse attention, and thereby retain the content. Furthermore, we fuse content information when building the target style representation, making it dynamic with respect to the content. Our method creates not only style-independent content representation, but also content-dependent style representation in transferring style. Empirical results show that our method outperforms the state-of-the-art baselines by a large margin in terms of content preservation. In addition, it is also competitive in terms of style transfer accuracy and fluency.
Code (1)
Tasks
DecoderSentenceStyle TransferText Style TransferMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
SC2: Towards Enhancing Content Preservation and Style Consistency in Long Text Style Transfer
Text style transfer (TST) aims to vary the style polarity of text while preserving the semantic content. Although recent advancements have demonstrated remarkable progress in short TST, it remains a relatively straightfo…
DecoderDenoisingStyle TransferText Style TransferStoryTrans: Non-Parallel Story Author-Style Transfer with Discourse Representations and Content Enhancing
Non-parallel text style transfer is an important task in natural language generation. However, previous studies concentrate on the token or sentence level, such as sentence sentiment and formality transfer, but neglect l…
SentenceStyle TransferText GenerationText Style TransferStructured Content Preservation for Unsupervised Text Style Transfer
Text style transfer aims to modify the style of a sentence while keeping its content unchanged. Recent style transfer systems often fail to faithfully preserve the content after changing the style. This paper proposes a …
Language ModelingLanguage ModellingSentenceStyle Transfer+2Cycle-Consistent Adversarial Autoencoders for Unsupervised Text Style Transfer
Unsupervised text style transfer is full of challenges due to the lack of parallel data and difficulties in content preservation. In this paper, we propose a novel neural approach to unsupervised text style transfer, whi…
Style TransferText Style TransferUnsupervised Text Style TransferStyle Transfer in Text: Exploration and Evaluation
Style transfer is an important problem in natural language processing (NLP). However, the progress in language style transfer is lagged behind other domains, such as computer vision, mainly because of the lack of paralle…
Style TransferText Style Transfer