paper-with-me

홈 › Papers

Instruct Once, Chat Consistently in Multiple Rounds: An Efficient Tuning Framework for Dialogue

2024-02-10 · Jian Wang, Chak Tou Leong, Jiashuo Wang, Dongding Lin, Wenjie Li, Xiao-Yong Wei

Tuning language models for dialogue generation has been a prevalent paradigm for building capable dialogue agents. Yet, traditional tuning narrowly views dialogue generation as resembling other language generation tasks, ignoring the role disparities between two speakers and the multi-round interactive process that dialogues ought to be. Such a manner often leads to unsatisfactory chat consistency for the built agent. In this work, we emphasize the interactive, communicative nature of dialogue and argue that it is more feasible to model the speaker roles of agent and user separately, enabling the agent to adhere to its role consistently. With this in mind, we propose an efficient Multi-round Interactive Dialogue Tuning (Midi-Tuning) framework. It models the agent and user individually with two adapters built upon large language models. The adapters make use of respective utterances round by round in alternating order and they are tuned via a round-level memory caching mechanism. Extensive experiments demonstrate that, our framework performs superior to traditional fine-tuning and harbors the tremendous potential for improving dialogue consistency.

📄 PDF Abstract BibTeX arXiv:2402.06967

Code (1)

iwangjian/midi-tuning 공식 구현 pytorch

Tasks

Dialogue GenerationText Generation

Similar Papers 제목 키워드 기반

Measuring and Controlling Instruction (In)Stability in Language Model Dialogs

2024-02-13 · Kenneth Li, Tianle Liu, Naomi Bashkansky, David Bau 외

System-prompting is a standard tool for customizing language-model chatbots, enabling them to follow a specific instruction. An implicit assumption in the use of system prompts is that they will be stable, so the chatbot…

ChatbotLanguage ModelingLanguage Modelling

Exploring Backdoor Vulnerabilities of Chat Models

2024-04-03 · Yunzhuo Hao, Wenkai Yang, Yankai Lin

Recent researches have shown that Large Language Models (LLMs) are susceptible to a security threat known as Backdoor Attack. The backdoored model will behave well in normal cases but exhibit malicious behaviours on inpu…

Backdoor Attack

TUTORING: Instruction-Grounded Conversational Agent for Language Learners

2023-02-24 · Hyungjoo Chae, Minjin Kim, Chaehyeong Kim, Wonseok Jeong 외

In this paper, we propose Tutoring bot, a generative chatbot trained on a large scale of tutor-student conversations for English-language learning. To mimic a human tutor's behavior in language education, the tutor bot l…

ChatbotMulti-Task LearningResponse Generation

ChatDiT: A Training-Free Baseline for Task-Agnostic Free-Form Chatting with Diffusion Transformers

2024-12-17 · Lianghua Huang, Wei Wang, Zhi-Fan Wu, Yupeng Shi 외

Recent research arXiv:2410.15027 arXiv:2410.23775 has highlighted the inherent in-context generation capabilities of pretrained diffusion transformers (DiTs), enabling them to seamlessly adapt to diverse visual tasks wit…

ArticlesForm

Non-Markov Multi-Round Conversational Image Generation with History-Conditioned MLLMs

2026-01-28 · Haochen Zhang, Animesh Sinha, Felix Juefei-Xu, Haoyu Ma 외 arxiv

Conversational image generation requires a model to follow user instructions across multiple rounds of interaction, grounded in interleaved text and images that accumulate as chat history. While recent multimodal large l…

Image ReconstructionImage Generation