paper-with-me

홈 › Papers

Enhancing Content Preservation in Text Style Transfer Using Reverse Attention and Conditional Layer Normalization

2021-08-01 · ACL 2021 5 · Dongkyu Lee, Zhiliang Tian, Lanqing Xue, Nevin L. Zhang

Text style transfer aims to alter the style (e.g., sentiment) of a sentence while preserving its content. A common approach is to map a given sentence to content representation that is free of style, and the content representation is fed to a decoder with a target style. Previous methods in filtering style completely remove tokens with style at the token level, which incurs the loss of content information. In this paper, we propose to enhance content preservation by implicitly removing the style information of each token with reverse attention, and thereby retain the content. Furthermore, we fuse content information when building the target style representation, making it dynamic with respect to the content. Our method creates not only style-independent content representation, but also content-dependent style representation in transferring style. Empirical results show that our method outperforms the state-of-the-art baselines by a large margin in terms of content preservation. In addition, it is also competitive in terms of style transfer accuracy and fluency.

📄 PDF Abstract BibTeX arXiv:2108.00449

Code (1)

MovingKyu/RACoLN 공식 구현 pytorch

Tasks

DecoderSentenceStyle TransferText Style Transfer

Methods 이 논문이 사용한 방법론

Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…

Similar Papers 제목 키워드 기반

SC2: Towards Enhancing Content Preservation and Style Consistency in Long Text Style Transfer

2024-06-07 · Jie Zhao, Ziyu Guan, Cai Xu, Wei Zhao 외

Text style transfer (TST) aims to vary the style polarity of text while preserving the semantic content. Although recent advancements have demonstrated remarkable progress in short TST, it remains a relatively straightfo…

DecoderDenoisingStyle TransferText Style Transfer

StoryTrans: Non-Parallel Story Author-Style Transfer with Discourse Representations and Content Enhancing

2022-08-29 · Xuekai Zhu, Jian Guan, Minlie Huang, Juan Liu

Non-parallel text style transfer is an important task in natural language generation. However, previous studies concentrate on the token or sentence level, such as sentence sentiment and formality transfer, but neglect l…

SentenceStyle TransferText GenerationText Style Transfer

Structured Content Preservation for Unsupervised Text Style Transfer

2018-10-15 · Youzhi Tian, Zhiting Hu, Zhou Yu

Text style transfer aims to modify the style of a sentence while keeping its content unchanged. Recent style transfer systems often fail to faithfully preserve the content after changing the style. This paper proposes a …

Language ModelingLanguage ModellingSentenceStyle Transfer+2

Cycle-Consistent Adversarial Autoencoders for Unsupervised Text Style Transfer

2020-10-02 · COLING 2020 8 · Yufang Huang, Wentao Zhu, Deyi Xiong, Yiye Zhang 외

Unsupervised text style transfer is full of challenges due to the lack of parallel data and difficulties in content preservation. In this paper, we propose a novel neural approach to unsupervised text style transfer, whi…

Style TransferText Style TransferUnsupervised Text Style Transfer

Style Transfer in Text: Exploration and Evaluation

2017-11-18 · Zhenxin Fu, Xiaoye Tan, Nanyun Peng, Dongyan Zhao 외

Style transfer is an important problem in natural language processing (NLP). However, the progress in language style transfer is lagged behind other domains, such as computer vision, mainly because of the lack of paralle…

Style TransferText Style Transfer