Contrastive Representation Learning for Exemplar-Guided Paraphrase Generation
Exemplar-Guided Paraphrase Generation (EGPG) aims to generate a target sentence which conforms to the style of the given exemplar while encapsulating the content information of the source sentence. In this paper, we propose a new method with the goal of learning a better representation of the style andthe content. This method is mainly motivated by the recent success of contrastive learning which has demonstrated its power in unsupervised feature extraction tasks. The idea is to design two contrastive losses with respect to the content and the style by considering two problem characteristics during training. One characteristic is that the target sentence shares the same content with the source sentence, and the second characteristic is that the target sentence shares the same style with the exemplar. These two contrastive losses are incorporated into the general encoder-decoder paradigm. Experiments on two datasets, namely QQP-Pos and ParaNMT, demonstrate the effectiveness of our proposed constrastive losses.
Code (1)
Tasks
Contrastive LearningDecoderParaphrase GenerationPOSQQPRepresentation LearningSentenceMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Syntax-guided Controlled Generation of Paraphrases
Given a sentence (e.g., "I like mangoes") and a constraint (e.g., sentiment flip), the goal of controlled text generation is to produce a sentence that adapts the input sentence to meet the requirements of the constraint…
Paraphrase GenerationSentenceText GenerationExemplar-Controllable Paraphrasing and Translation using Bitext
Most prior work on exemplar-based syntactically controlled paraphrase generation relies on automatically-constructed large-scale paraphrase datasets, which are costly to create. We sidestep this prerequisite by adapting …
Machine TranslationParaphrase GenerationTranslationGCPG: A General Framework for Controllable Paraphrase Generation
Controllable paraphrase generation (CPG) incorporates various external conditions to obtain desirable paraphrases. However, existing works only highlight a special condition under two indispensable aspects of CPG (i.e., …
DecoderParaphrase GenerationSentenceGCPG: A General Framework for Controllable Paraphrase Generation
Controllable paraphrase generation (CPG) incorporates various external conditions to obtain desirable paraphrases. However, existing works only highlight a special condition under two indispensable aspects of CPG (i.e., …
DecoderParaphrase GenerationSentenceMarginal Contrastive Correspondence for Guided Image Generation
Exemplar-based image translation establishes dense correspondences between a conditional input and an exemplar (from two different domains) for leveraging detailed exemplar styles to achieve realistic image translation. …
Contrastive LearningImage GenerationTexture SynthesisTranslation