Generate, Delete and Rewrite: A Three-Stage Framework for Improving Persona Consistency of Dialogue Generation
Maintaining a consistent personality in conversations is quite natural for human beings, but is still a non-trivial task for machines. The persona-based dialogue generation task is thus introduced to tackle the personality-inconsistent problem by incorporating explicit persona text into dialogue generation models. Despite the success of existing persona-based models on generating human-like responses, their one-stage decoding framework can hardly avoid the generation of inconsistent persona words. In this work, we introduce a three-stage framework that employs a generate-delete-rewrite mechanism to delete inconsistent words from a generated response prototype and further rewrite it to a personality-consistent one. We carry out evaluations by both human and automatic metrics. Experiments on the Persona-Chat dataset show that our approach achieves good performance.
Code (0)
등록된 구현이 없습니다.
Tasks
Dialogue GenerationSimilar Papers 제목 키워드 기반
IterQR: An Iterative Framework for LLM-based Query Rewrite in e-Commercial Search System
The essence of modern e-Commercial search system lies in matching user's intent and available candidates depending on user's query, providing personalized and precise service. However, user's query may be incorrect due t…
RAGRetrieval-augmented GenerationWorld KnowledgeLearning to Rewrite Prompts for Personalized Text Generation
Facilitated by large language models (LLMs), personalized text generation has become a rapidly growing research direction. Most existing studies focus on designing specialized models for a particular domain, or they requ…
Language ModellingLarge Language Modelreinforcement-learningReinforcement Learning+2Two-stage Incomplete Utterance Rewriting on Editing Operation
Previous work on Incomplete Utterance Rewriting (IUR) has primarily focused on generating rewritten utterances based solely on dialogue context, ignoring the widespread phenomenon of coreference and ellipsis in dialogues…
ReToP: Learning to Rewrite Electronic Health Records for Clinical Prediction
Electronic Health Records (EHRs) provide crucial information for clinical decision-making. However, their high-dimensionality, heterogeneity, and sparsity make clinical prediction challenging. Large Language Models (LLMs…
A Distribution-Free Framework for Rewrite-Based Human-text Detection via Knockoff Filtering
We propose a distribution-free statistical framework that converts arbitrary rewrite-based detectors into detectors with finite-sample FDR guarantees without retraining. Our key observation is that rewrite-based detectio…
Text Detection