Style Transfer as Unsupervised Machine Translation
Language style transferring rephrases text with specific stylistic attributes while preserving the original attribute-independent content. One main challenge in learning a style transfer system is a lack of parallel data where the source sentence is in one style and the target sentence in another style. With this constraint, in this paper, we adapt unsupervised machine translation methods for the task of automatic style transfer. We first take advantage of style-preference information and word embedding similarity to produce pseudo-parallel data with a statistical machine translation (SMT) framework. Then the iterative back-translation approach is employed to jointly train two neural machine translation (NMT) based transfer systems. To control the noise generated during joint training, a style classifier is introduced to guarantee the accuracy of style transfer and penalize bad candidates in the generated pseudo data. Experiments on benchmark datasets show that our proposed method outperforms previous state-of-the-art models in terms of both accuracy of style transfer and quality of input-output correspondence.
Code (0)
등록된 구현이 없습니다.
Tasks
AttributeMachine TranslationNMTSentenceStyle TransferTranslationUnsupervised Machine TranslationSimilar Papers 제목 키워드 기반
A Probabilistic Formulation of Unsupervised Text Style Transfer
We present a deep generative model for unsupervised text style transfer that unifies previously proposed non-generative techniques. Our probabilistic approach models non-parallel data from two domains as a partially obse…
DeciphermentLanguage ModellingMachine TranslationStyle Transfer+5Unsupervised Text Style Transfer with Content Embeddings
The style transfer task (here style is used in a broad “authorial” sense with many aspects including register, sentence structure, and vocabulary choice) takes text input and rewrites it in a specified target style prese…
Language ModelingLanguage ModellingMachine TranslationSentence+4Exploiting Social Media Content for Self-Supervised Style Transfer
Recent research on style transfer takes inspiration from unsupervised neural machine translation (UNMT), learning from large amounts of non-parallel data by exploiting cycle consistency loss, back-translation, and denois…
AttributeDenoisingMachine TranslationNMT+2Translating away Translationese without Parallel Data
Translated texts exhibit systematic linguistic differences compared to original texts in the same language, and these differences are referred to as translationese. Translationese has effects on various cross-lingual nat…
Binary ClassificationLanguage ModellingSemantic SimilaritySemantic Textual Similarity+1Unsupervised Text Summarization via Mixed Model Back-Translation
Back-translation based approaches have recently lead to significant progress in unsupervised sequence-to-sequence tasks such as machine translation or style transfer. In this work, we extend the paradigm to the problem o…
Machine TranslationSentenceSentence SummarizationStyle Transfer+4