Multi-Attribute Controlled Text Generation with Contrastive-Generator and External-Discriminator
Though existing researches have achieved impressive results in controlled text generation, they focus mainly on single-attribute control. However, in applications like automatic comments, the topic and sentiment need to be controlled simultaneously. In this work, we propose a new framework for multi-attribute controlled text generation. To achieve this, we design a contrastive-generator that can effectively generate texts with more attributes. In order to increase the convergence of the text on the desired attributes, we adopt an external-discriminator to distinguish whether the generated text holds the desired attributes. Moreover, we propose top-n weighted decoding to further improve the relevance of texts to attributes. Automated evaluations and human evaluations show that our framework achieves remarkable controllability in multi-attribute generation while keeping the text fluent and diverse. It also yields promising performance on zero-shot generation.
Code (0)
등록된 구현이 없습니다.
Tasks
AttributeComment GenerationText GenerationSimilar Papers 제목 키워드 기반
Controlled Text Generation with Hidden Representation Transformations
We propose CHRT (Control Hidden Representation Transformation) - a controlled language generation framework that steers large language models to generate text pertaining to certain attributes (such as toxicity). CHRT gai…
AttributeContrastive LearningText GenerationText SimplificationEnhancing Diffusion Face Generation with Contrastive Embeddings and SegFormer Guidance
We present a benchmark of diffusion models for human face generation on a small-scale CelebAMask-HQ dataset, evaluating both unconditional and conditional pipelines. Our study compares UNet and DiT architectures for unco…
C$^3$TG: Conflict-aware, Composite, and Collaborative Controlled Text Generation
Recent advancements in large language models (LLMs) have demonstrated remarkable text generation capabilities. However, controlling specific attributes of generated text remains challenging without architectural modifica…
Text GenerationP-Masking: Power Law Masking Improves Multi-attribute Controlled Generation
We introduce LingGen, a novel approach for controlled text generation that offers precise control over a wide array of linguistic attributes, even as the number of attributes varies. LingGen employs a dynamic P-MASKING s…
AttributeText GenerationTailor: A Prompt-Based Approach to Attribute-Based Controlled Text Generation
Attribute-based Controlled Text Generation (CTG) refers to generating sentences that satisfy desirable attributes (e.g., emotions and topics). Existing works often utilize fine-tuning or resort to extra attribute classif…
AttributePositionText Generation