paper-with-me

홈 › Papers

Mix-Initiative Response Generation with Dynamic Prefix Tuning

2024-03-26 · Yuxiang Nie, Heyan Huang, Xian-Ling Mao, Lizi Liao

Mixed initiative serves as one of the key factors in controlling conversation directions. For a speaker, responding passively or leading proactively would result in rather different responses. However, most dialogue systems focus on training a holistic response generation model without any distinction among different initiatives. It leads to the cross-contamination problem, where the model confuses different initiatives and generates inappropriate responses. Moreover, obtaining plenty of human annotations for initiative labels can be expensive. To address this issue, we propose a general mix-Initiative Dynamic Prefix Tuning framework (IDPT) to decouple different initiatives from the generation model, which learns initiative-aware prefixes in both supervised and unsupervised settings. Specifically, IDPT decouples initiative factors into different prefix parameters and uses the attention mechanism to adjust the selection of initiatives in guiding generation dynamically. The prefix parameters can be tuned towards accurate initiative prediction as well as mix-initiative response generation. Extensive experiments on two public dialogue datasets show that the proposed IDPT outperforms previous baselines on both automatic metrics and human evaluations. It also manages to generate appropriate responses with manipulated initiatives.

📄 PDF Abstract BibTeX arXiv:2403.17636

Code (0)

등록된 구현이 없습니다.

Tasks

Response Generation

Methods 이 논문이 사용한 방법론

Focus 설명 없음

Similar Papers 제목 키워드 기반

KnowPrefix-Tuning: A Two-Stage Prefix-Tuning Framework for Knowledge-Grounded Dialogue Generation

2023-06-27 · Jiaqi Bai, Zhao Yan, Jian Yang, Xinnian Liang 외

Existing knowledge-grounded conversation systems generate responses typically in a retrieve-then-generate manner. They require a large knowledge base and a strong knowledge retrieval component, which is time- and resourc…

Dialogue GenerationResponse GenerationRetrieval

Controllable Mixed-Initiative Dialogue Generation through Prompting

2023-05-06 · Maximillian Chen, Xiao Yu, Weiyan Shi, Urvi Awasthi 외

Mixed-initiative dialogue tasks involve repeated exchanges of information and conversational control. Conversational agents gain control by generating responses that follow particular dialogue intents or strategies, pres…

Dialogue Generation

Contextual Dynamic Prompting for Response Generation in Task-oriented Dialog Systems

2023-01-30 · Sandesh Swamy, Narges Tabari, Chacha Chen, Rashmi Gangadharaiah

Response generation is one of the critical components in task-oriented dialog systems. Existing studies have shown that large pre-trained language models can be adapted to this task. The typical paradigm of adapting such…

Response Generation

Schema-Guided Semantic Accuracy: Faithfulness in Task-Oriented Dialogue Response Generation

2023-01-29 · Jinghong Chen, Weizhe Lin, Bill Byrne

Ensuring that generated utterances are faithful to dialogue actions is crucial for Task-Oriented Dialogue Response Generation. Slot Error Rate (SER) only partially measures generation quality in that it solely assesses u…

Natural Language InferenceResponse Generation

Control Prefixes for Parameter-Efficient Text Generation

2021-10-15 · Jordan Clive, Kris Cao, Marek Rei

Prefix-tuning is a powerful lightweight technique for adapting a large pre-trained language model to a downstream application. However, it uses the same dataset-level tuned prompt for all examples in the dataset. We exte…

Abstractive Text SummarizationAttributeData-to-Text GenerationLanguage Modeling+4