Formality Style Transfer for Noisy, User-generated Conversations: Extracting Labeled, Parallel Data from Unlabeled Corpora
Typical datasets used for style transfer in NLP contain aligned pairs of two opposite extremes of a style. As each existing dataset is sourced from a specific domain and context, most use cases will have a sizable mismatch from the vocabulary and sentence structures of any dataset available. This reduces the performance of the style transfer, and is particularly significant for noisy, user-generated text. To solve this problem, we show a technique to derive a dataset of aligned pairs (style-agnostic vs stylistic sentences) from an unlabeled corpus by using an auxiliary dataset, allowing for in-domain training. We test the technique with the Yahoo Formality Dataset and 6 novel datasets we produced, which consist of scripts from 5 popular TV-shows (Friends, Futurama, Seinfeld, Southpark, Stargate SG-1) and the Slate Star Codex online forum. We gather 1080 human evaluations, which show that our method produces a sizable change in formality while maintaining fluency and context; and that it considerably outperforms OpenNMT{'}s Seq2Seq model directly trained on the Yahoo Formality Dataset. Additionally, we publish the full pipeline code and our novel datasets.
Code (0)
등록된 구현이 없습니다.
Tasks
Formality Style TransferSentenceStyle TransferMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Improving Formality Style Transfer with Context-Aware Rule Injection
Models pre-trained on large-scale regular text corpora often do not work well for user-generated data where the language styles differ significantly from the mainstream text. Here we present Context-Aware Rule Injection …
DecoderFormality Style TransferSentiment AnalysisStyle TransferSemi-supervised Formality Style Transfer using Language Model Discriminator and Mutual Information Maximization
Formality style transfer is the task of converting informal sentences to grammatically-correct formal sentences, which can be used to improve performance of many downstream NLP tasks. In this work, we propose a semi-supe…
Formality Style TransferLanguage ModelingLanguage ModellingSemi-Supervised Formality Style Transfer+4Formality Style Transfer with Hybrid Textual Annotations
Formality style transformation is the task of modifying the formality of a given sentence without changing its content. Its challenge is the lack of large-scale sentence-aligned parallel data. In this paper, we propose a…
Formality Style TransferSentenceStyle TransferText Style Transfer+1Multi-Task Neural Models for Translating Between Styles Within and Across Languages
Generating natural language requires conveying content in an appropriate style. We explore two related tasks on generating text of varying formality: monolingual formality transfer and formality-sensitive machine transla…
Machine TranslationMulti-Task LearningTranslationFormality Style Transfer with Shared Latent Space
Conventional approaches for formality style transfer borrow models from neural machine translation, which typically requires massive parallel data for training. However, the dataset for formality style transfer is consid…
Formality Style TransferMachine TranslationStyle TransferTranslation