paper-with-me

Papers

MORPHEUS: Modeling Role from Personalized Dialogue History by Exploring and Utilizing Latent Space

2024-07-02 · Yihong Tang, Bo wang, Dongming Zhao, Xiaojia Jin, Jijun Zhang, Ruifang He, Yuexian Hou

Personalized Dialogue Generation (PDG) aims to create coherent responses according to roles or personas. Traditional PDG relies on external role data, which can be scarce and raise privacy concerns. Approaches address these issues by extracting role information from dialogue history, which often fail to generically model roles in continuous space. To overcome these limitations, we introduce a novel framework \textbf{MO}dels \textbf{R}oles from \textbf{P}ersonalized Dialogue \textbf{H}istory by \textbf{E}xploring and \textbf{U}tilizing Latent \textbf{S}pace (MORPHEUS) through a three-stage training process. Specifically, we create a persona codebook to represent roles in latent space compactly, and this codebook is used to construct a posterior distribution of role information. This method enables the model to generalize across roles, allowing the generation of personalized dialogues even for unseen roles. Experiments on both Chinese and English datasets demonstrate that MORPHEUS enhances the extraction of role information, and improves response generation without external role data. Additionally, MORPHEUS can be considered an efficient fine-tuning for large language models.

📄 PDF Abstract BibTeX arXiv:2407.02345

Code (0)

등록된 구현이 없습니다.

Tasks

Dialogue GenerationResponse Generation

Similar Papers 제목 키워드 기반

Less is More: Learning to Refine Dialogue History for Personalized Dialogue Generation

2022-04-18 · NAACL 2022 7 · Hanxun Zhong, Zhicheng Dou, Yutao Zhu, Hongjin Qian 외

Personalized dialogue systems explore the problem of generating responses that are consistent with the user's personality, which has raised much attention in recent years. Existing personalized dialogue systems have trie…

Dialogue GenerationResponse Generation

Less is More: Learning to Refine Dialogue History for Personalized Dialogue Generation

2022-01-16 · ACL ARR January 2022 1 · Anonymous

Personalized dialogue systems explore the problem of generating responses that are consistent with the user's personality, which have raised much attention in recent years. Existing personalized dialogue systems have tri…

Dialogue GenerationResponse Generation

Enhancing Personalized Dialogue Generation with Contrastive Latent Variables: Combining Sparse and Dense Persona

2023-05-19 · Yihong Tang, Bo wang, Miao Fang, Dongming Zhao 외

The personalized dialogue explores the consistent relationship between dialogue generation and personality. Existing personalized dialogue agents model persona profiles from three resources: sparse or dense persona descr…

Dialogue Generation

Dialogue History Matters! Personalized Response Selectionin Multi-turn Retrieval-based Chatbots

2021-03-17 · Juntao Li, Chang Liu, Chongyang Tao, Zhangming Chan 외

Existing multi-turn context-response matching methods mainly concentrate on obtaining multi-level and multi-dimension representations and better interactions between context utterances and response. However, in real-plac…

Representation LearningRetrievalUser Identification

MCP: Self-supervised Pre-training for Personalized Chatbots with Multi-level Contrastive Sampling

2022-10-17 · Zhaoheng Huang, Zhicheng Dou, Yutao Zhu, Zhengyi Ma

Personalized chatbots focus on endowing the chatbots with a consistent personality to behave like real users and further act as personal assistants. Previous studies have explored generating implicit user profiles from t…

Response GenerationSelf-Supervised Learning