Towards Zero-Shot Personalized Table-to-Text Generation with Contrastive Persona Distillation
Existing neural methods have shown great potentials towards generating informative text from structured tabular data as well as maintaining high content fidelity. However, few of them shed light on generating personalized expressions, which often requires well-aligned persona-table-text datasets that are difficult to obtain. To overcome these obstacles, we explore personalized table-to-text generation under a zero-shot setting, by assuming no well-aligned persona-table-text triples are required during training. To this end, we firstly collect a set of unpaired persona information and then propose a semi-supervised approach with contrastive persona distillation (S2P-CPD) to generate personalized context. Specifically, tabular data and persona information are firstly represented as latent variables separately. Then, we devise a latent space fusion technique to distill persona information into the table representation. Besides, a contrastive-based discriminator is employed to guarantee the style consistency between the generated context and its corresponding persona. Experimental results on two benchmarks demonstrate S2P-CPD's ability on keeping both content fidelity and personalized expressions.
Code (0)
등록된 구현이 없습니다.
Tasks
Table-to-Text GenerationText GenerationSimilar Papers 제목 키워드 기반
Conceptrol: Concept Control of Zero-shot Personalized Image Generation
Personalized image generation with text-to-image diffusion models generates unseen images based on reference image content. Zero-shot adapter methods such as IP-Adapter and OminiControl are especially interesting because…
Image GenerationPersonalized Image GenerationGenerative Data Augmentation Challenge: Zero-Shot Speech Synthesis for Personalized Speech Enhancement
This paper presents a new challenge that calls for zero-shot text-to-speech (TTS) systems to augment speech data for the downstream task, personalized speech enhancement (PSE), as part of the Generative Data Augmentation…
Data AugmentationSpeech EnhancementSpeech SynthesisSynthetic Data Generation+2Dynamic Strategy Chain: Dynamic Zero-Shot CoT for Long Mental Health Support Generation
Long counseling Text Generation for Mental health support (LTGM), an innovative and challenging task, aims to provide help-seekers with mental health support through a comprehensive and more acceptable response. The comb…
Text GenerationEZIGen: Enhancing zero-shot personalized image generation with precise subject encoding and decoupled guidance
Zero-shot personalized image generation models aim to produce images that align with both a given text prompt and subject image, requiring the model to effectively incorporate both sources of guidance. However, existing …
DenoisingImage GenerationPersonalized Image GenerationSubject TransferHyperLoRA: Parameter-Efficient Adaptive Generation for Portrait Synthesis
Personalized portrait synthesis, essential in domains like social entertainment, has recently made significant progress. Person-wise fine-tuning based methods, such as LoRA and DreamBooth, can produce photorealistic outp…