paper-with-me

홈 › Papers

``Transforming'' Delete, Retrieve, Generate Approach for Controlled Text Style Transfer

2019-11-01 · IJCNLP 2019 11 · Akhilesh Sudhakar, Bhargav Upadhyay, Arjun Maheswaran

Text style transfer is the task of transferring the style of text having certain stylistic attributes, while preserving non-stylistic or content information. In this work we introduce the Generative Style Transformer (GST) - a new approach to rewriting sentences to a target style in the absence of parallel style corpora. GST leverages the power of both, large unsupervised pre-trained language models as well as the Transformer. GST is a part of a larger {`}Delete Retrieve Generate{'} framework, in which we also propose a novel method of deleting style attributes from the source sentence by exploiting the inner workings of the Transformer. Our models outperform state-of-art systems across 5 datasets on sentiment, gender and political slant transfer. We also propose the use of the GLEU metric as an automatic metric of evaluation of style transfer, which we found to compare better with human ratings than the predominantly used BLEU score.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

SentenceStyle TransferText Style Transfer

Methods 이 논문이 사용한 방법론

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Position-Wise Feed-Forward Layer 설명 없음
Residual Connection 설명 없음
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
ReLU How Do I Communicate to Expedia? How Do I Communicate to Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Live Support & Special Travel…

Similar Papers 제목 키워드 기반

Transforming Delete, Retrieve, Generate Approach for Controlled Text Style Transfer

2019-08-25 · Akhilesh Sudhakar, Bhargav Upadhyay, Arjun Maheswaran

Text style transfer is the task of transferring the style of text having certain stylistic attributes, while preserving non-stylistic or content information. In this work we introduce the Generative Style Transformer (GS…

SentenceStyle TransferText GenerationText Style Transfer

Delete, Retrieve, Generate: A Simple Approach to Sentiment and Style Transfer

2018-04-17 · NAACL 2018 6 · Juncen Li, Robin Jia, He He, Percy Liang

We consider the task of text attribute transfer: transforming a sentence to alter a specific attribute (e.g., sentiment) while preserving its attribute-independent content (e.g., changing "screen is just the right size" …

AttributeImage CaptioningSentenceStyle Transfer+2

An Operation Network for Abstractive Sentence Compression

2018-08-01 · COLING 2018 8 · Naitong Yu, Jie Zhang, Minlie Huang, Xiaoyan Zhu

Sentence compression condenses a sentence while preserving its most important contents. Delete-based models have the strong ability to delete undesired words, while generate-based models are able to reorder or rephrase t…

SentenceSentence CompressionText Generation

Generate, Delete and Rewrite: A Three-Stage Framework for Improving Persona Consistency of Dialogue Generation

2020-04-16 · ACL 2020 6 · Haoyu Song, Yan Wang, Wei-Nan Zhang, Xiaojiang Liu 외

Maintaining a consistent personality in conversations is quite natural for human beings, but is still a non-trivial task for machines. The persona-based dialogue generation task is thus introduced to tackle the personali…

Dialogue Generation

Inference via Sparse Coding in a Hierarchical Vision Model

2021-08-03 · Joshua Bowren, Luis Sanchez-Giraldo, Odelia Schwartz

Sparse coding has been incorporated in models of the visual cortex for its computational advantages and connection to biology. But how the level of sparsity contributes to performance on visual tasks is not well understo…

image-classificationImage ClassificationSensitivityTexture Classification