Improving Formality Style Transfer with Context-Aware Rule Injection
Models pre-trained on large-scale regular text corpora often do not work well for user-generated data where the language styles differ significantly from the mainstream text. Here we present Context-Aware Rule Injection (CARI), an innovative method for formality style transfer (FST). CARI injects multiple rules into an end-to-end BERT-based encoder and decoder model. It learns to select optimal rules based on context. The intrinsic evaluation showed that CARI achieved the new highest performance on the FST benchmark dataset. Our extrinsic evaluation showed that CARI can greatly improve the regular pre-trained models' performance on several tweet sentiment analysis tasks.
Code (0)
등록된 구현이 없습니다.
Tasks
DecoderFormality Style TransferSentiment AnalysisStyle TransferSimilar Papers 제목 키워드 기반
Harnessing Pre-Trained Neural Networks with Rules for Formality Style Transfer
Formality text style transfer plays an important role in various NLP applications, such as non-native speaker assistants and child education. Early studies normalize informal sentences with rules, before statistical and …
Formality Style TransferStyle TransferText Style TransferFormality Style Transfer for Noisy, User-generated Conversations: Extracting Labeled, Parallel Data from Unlabeled Corpora
Typical datasets used for style transfer in NLP contain aligned pairs of two opposite extremes of a style. As each existing dataset is sourced from a specific domain and context, most use cases will have a sizable mismat…
Formality Style TransferSentenceStyle TransferContextual Text Style Transfer
We introduce a new task, Contextual Text Style Transfer - translating a sentence into a desired style with its surrounding context taken into account. This brings two key challenges to existing style transfer approaches:…
SentenceStyle TransferText Style TransferTranslationFormality Style Transfer with Hybrid Textual Annotations
Formality style transformation is the task of modifying the formality of a given sentence without changing its content. Its challenge is the lack of large-scale sentence-aligned parallel data. In this paper, we propose a…
Formality Style TransferSentenceStyle TransferText Style Transfer+1Multi-Task Neural Models for Translating Between Styles Within and Across Languages
Generating natural language requires conveying content in an appropriate style. We explore two related tasks on generating text of varying formality: monolingual formality transfer and formality-sensitive machine transla…
Machine TranslationMulti-Task LearningTranslation