VAE based Text Style Transfer with Pivot Words Enhancement Learning
Text Style Transfer (TST) aims to alter the underlying style of the source text to another specific style while keeping the same content. Due to the scarcity of high-quality parallel training data, unsupervised learning has become a trending direction for TST tasks. In this paper, we propose a novel VAE based Text Style Transfer with pivOt Words Enhancement leaRning (VT-STOWER) method which utilizes Variational AutoEncoder (VAE) and external style embeddings to learn semantics and style distribution jointly. Additionally, we introduce pivot words learning, which is applied to learn decisive words for a specific style and thereby further improve the overall performance of the style transfer. The proposed VT-STOWER can be scaled to different TST scenarios given very limited and non-parallel training data with a novel and flexible style strength control mechanism. Experiments demonstrate that the VT-STOWER outperforms the state-of-the-art on sentiment, formality, and code-switching TST tasks.
Code (4)
Tasks
Style TransferText Style TransferSimilar Papers 제목 키워드 기반
Rethinking Text Attribute Transfer: A Lexical Analysis
Text attribute transfer is modifying certain linguistic attributes (e.g. sentiment, style, authorship, etc.) of a sentence and transforming them from one type to another. In this paper, we aim to analyze and interpret wh…
AttributeGeneral ClassificationLexical AnalysisSentence+1NAST: A Non-Autoregressive Generator with Word Alignment for Unsupervised Text Style Transfer
Autoregressive models have been widely used in unsupervised text style transfer. Despite their success, these models still suffer from the content preservation problem that they usually ignore part of the source sentence…
SentenceStyle TransferText Style TransferUnsupervised Text Style Transfer+1Text Style Transfer: An Introductory Overview
Text Style Transfer (TST) is a pivotal task in natural language generation to manipulate text style attributes while preserving style-independent content. The attributes targeted in TST can vary widely, including politen…
Style TransferText GenerationText Style TransferConversation Style Transfer using Few-Shot Learning
Conventional text style transfer approaches focus on sentence-level style transfer without considering contextual information, and the style is described with attributes (e.g., formality). When applying style transfer in…
Few-Shot LearningIn-Context Learningintent-classificationIntent Classification+3Text Detoxification using Large Pre-trained Neural Models
We present two novel unsupervised methods for eliminating toxicity in text. Our first method combines two recent ideas: (1) guidance of the generation process with small style-conditional language models and (2) use of p…
Style Transfer