paper-with-me

홈 › Papers

Chat Vector: A Simple Approach to Equip LLMs with Instruction Following and Model Alignment in New Languages

2023-10-07 · Shih-Cheng Huang, Pin-Zu Li, Yu-Chi Hsu, Kuang-Ming Chen, Yu Tung Lin, Shih-Kai Hsiao, Richard Tzong-Han Tsai, Hung-Yi Lee

Recently, the development of open-source large language models (LLMs) has advanced rapidly. Nevertheless, due to data constraints, the capabilities of most open-source LLMs are primarily focused on English. To address this issue, we introduce the concept of $\textit{chat vector}$ to equip pre-trained language models with instruction following and human value alignment via simple model arithmetic. The chat vector is derived by subtracting the weights of a pre-trained base model (e.g. LLaMA2) from those of its corresponding chat model (e.g. LLaMA2-chat). By simply adding the chat vector to a continual pre-trained model's weights, we can endow the model with chat capabilities in new languages without the need for further training. Our empirical studies demonstrate the superior efficacy of the chat vector from three different aspects: instruction following, toxicity mitigation, and multi-turn dialogue. Moreover, to showcase the adaptability of our approach, we extend our experiments to encompass various languages, base models, and chat vectors. The results underscore the chat vector's simplicity, effectiveness, and wide applicability, making it a compelling solution for efficiently enabling conversational capabilities in pre-trained language models. Our code is available at https://github.com/aqweteddy/ChatVector.

📄 PDF Abstract BibTeX arXiv:2310.04799

Code (2)

aqweteddy/ChatVector pytorch
augmxnt/deccp jax

Tasks

Instruction Following

Methods 이 논문이 사용한 방법론

BASE 설명 없음
SFT Shrink and Fine-Tune, or SFT, is a type of distillation that avoids explicit distillation by copying parameters to a student student model and then fine-tuning.…

Similar Papers 제목 키워드 기반

ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIs

2023-07-31 · Yujia Qin, Shihao Liang, Yining Ye, Kunlun Zhu 외

Despite the advancements of open-source large language models (LLMs), e.g., LLaMA, they remain significantly limited in tool-use capabilities, i.e., using external tools (APIs) to fulfill human instructions. The reason i…

Trajectory PlanningZero-shot Generalization

Refusal-Trained LLMs Are Easily Jailbroken As Browser Agents

2024-10-11 · Priyanshu Kumar, Elaine Lau, Saranya Vijayakumar, Tu Trinh 외

For safety reasons, large language models (LLMs) are trained to refuse harmful user instructions, such as assisting dangerous activities. We study an open question in this work: does the desired safety refusal, typically…

ChatbotRed Teaming

The Construction of Instruction-tuned LLMs for Finance without Instruction Data Using Continual Pretraining and Model Merging

2024-09-30 · Masanori Hirano, Kentaro Imajo

This paper proposes a novel method for constructing instruction-tuned large language models (LLMs) for finance without instruction data. Traditionally, developing such domain-specific LLMs has been resource-intensive, re…

Continual Pretraining

Large Language Models Are Overconfident in Their Own Responses

2026-06-02 · Mario Sanz-Guerrero, Manuel Mager, Katharina von der Wense arxiv

Prior work has shown that instruction-tuned large language models (LLMs) are less well calibrated than their base pre-trained counterparts. However, little is known about the frequently used chat template's effect on the…

An Empirical Study of Instruction-tuning Large Language Models in Chinese

2023-10-11 · Qingyi Si, Tong Wang, Zheng Lin, Xu Zhang 외

The success of ChatGPT validates the potential of large language models (LLMs) in artificial general intelligence (AGI). Subsequently, the release of LLMs has sparked the open-source community's interest in instruction-t…