MORPHEUS: Modeling Role from Personalized Dialogue History by Exploring and Utilizing Latent Space
Personalized Dialogue Generation (PDG) aims to create coherent responses according to roles or personas. Traditional PDG relies on external role data, which can be scarce and raise privacy concerns. Approaches address these issues by extracting role information from dialogue history, which often fail to generically model roles in continuous space. To overcome these limitations, we introduce a novel framework \textbf{MO}dels \textbf{R}oles from \textbf{P}ersonalized Dialogue \textbf{H}istory by \textbf{E}xploring and \textbf{U}tilizing Latent \textbf{S}pace (MORPHEUS) through a three-stage training process. Specifically, we create a persona codebook to represent roles in latent space compactly, and this codebook is used to construct a posterior distribution of role information. This method enables the model to generalize across roles, allowing the generation of personalized dialogues even for unseen roles. Experiments on both Chinese and English datasets demonstrate that MORPHEUS enhances the extraction of role information, and improves response generation without external role data. Additionally, MORPHEUS can be considered an efficient fine-tuning for large language models.
Code (0)
등록된 구현이 없습니다.
Tasks
Dialogue GenerationResponse GenerationSimilar Papers 제목 키워드 기반
Less is More: Learning to Refine Dialogue History for Personalized Dialogue Generation
Personalized dialogue systems explore the problem of generating responses that are consistent with the user's personality, which has raised much attention in recent years. Existing personalized dialogue systems have trie…
Dialogue GenerationResponse GenerationLess is More: Learning to Refine Dialogue History for Personalized Dialogue Generation
Personalized dialogue systems explore the problem of generating responses that are consistent with the user's personality, which have raised much attention in recent years. Existing personalized dialogue systems have tri…
Dialogue GenerationResponse GenerationEnhancing Personalized Dialogue Generation with Contrastive Latent Variables: Combining Sparse and Dense Persona
The personalized dialogue explores the consistent relationship between dialogue generation and personality. Existing personalized dialogue agents model persona profiles from three resources: sparse or dense persona descr…
Dialogue GenerationDialogue History Matters! Personalized Response Selectionin Multi-turn Retrieval-based Chatbots
Existing multi-turn context-response matching methods mainly concentrate on obtaining multi-level and multi-dimension representations and better interactions between context utterances and response. However, in real-plac…
Representation LearningRetrievalUser IdentificationMCP: Self-supervised Pre-training for Personalized Chatbots with Multi-level Contrastive Sampling
Personalized chatbots focus on endowing the chatbots with a consistent personality to behave like real users and further act as personal assistants. Previous studies have explored generating implicit user profiles from t…
Response GenerationSelf-Supervised Learning