Replacing Language Model for Style Transfer
We introduce replacing language model (RLM), a sequence-to-sequence language modeling framework for text style transfer (TST). Our method autoregressively replaces each token of the source sentence with a text span that has a similar meaning but in the target style. The new span is generated via a non-autoregressive masked language model, which can better preserve the local-contextual meaning of the replaced token. This RLM generation scheme gathers the flexibility of autoregressive models and the accuracy of non-autoregressive models, which bridges the gap between sentence-level and word-level style transfer methods. To control the generation style more precisely, we conduct a token-level style-content disentanglement on the hidden representations of RLM. Empirical results on real-world text datasets demonstrate the effectiveness of RLM compared with other TST baselines. The code is at https://github.com/Linear95/RLM.
Code (1)
Tasks
DisentanglementLanguage ModelingLanguage ModellingmodelSentenceSequence-to-sequence Language ModelingStyle TransferText Style TransferSimilar Papers 제목 키워드 기반
Singing Style Transfer Using Cycle-Consistent Boundary Equilibrium Generative Adversarial Networks
Can we make a famous rap singer like Eminem sing whatever our favorite song? Singing style transfer attempts to make this possible, by replacing the vocal of a song from the source singer to the target singer. This paper…
Style TransferNeural Neighbor Style Transfer
We propose Neural Neighbor Style Transfer (NNST), a pipeline that offers state-of-the-art quality, generalization, and competitive efficiency for artistic style transfer. Our approach is based on explicitly replacing neu…
Style TransferAn Empirical Study on Multi-Task Learning for Text Style Transfer and Paraphrase Generation
The topic of this paper is neural multi-task training for text style transfer. We present an efficient method for neutral-to-style transformation using the transformer framework. We demonstrate how to prepare a robust mo…
Multi-Task LearningParaphrase GenerationStyle TransferText Style TransferData Augmentation Through Random Style Replacement
In this paper, we introduce a novel data augmentation technique that combines the advantages of style augmentation and random erasing by selectively replacing image subregions with style-transferred patches. Our approach…
Data AugmentationStyle TransferAn Interpretable X-ray Style Transfer via Trainable Local Laplacian Filter
Radiologists have preferred visual impressions or 'styles' of X-ray images that are manually adjusted to their needs to support their diagnostic performance. In this work, we propose an automatic and interpretable X-ray …
DiagnosticSSIMStyle Transfer