paper-with-me

홈 › Papers

Demystifying Instruction Mixing for Fine-tuning Large Language Models

2023-12-17 · Renxi Wang, Haonan Li, Minghao Wu, Yuxia Wang, Xudong Han, Chiyu Zhang, Timothy Baldwin

Instruction tuning significantly enhances the performance of large language models (LLMs) across various tasks. However, the procedure to optimizing the mixing of instruction datasets for LLM fine-tuning is still poorly understood. This study categorizes instructions into three primary types: NLP downstream tasks, coding, and general chat. We explore the effects of instruction tuning on different combinations of datasets on LLM performance, and find that certain instruction types are more advantageous for specific applications but can negatively impact other areas. This work provides insights into instruction mixtures, laying the foundations for future research.

📄 PDF Abstract BibTeX arXiv:2312.10793

Code (1)

reason-wang/instructllm 공식 구현 pytorch

Tasks

Language ModellingLarge Language Model

Similar Papers 제목 키워드 기반

LIMIT: Less Is More for Instruction Tuning Across Evaluation Paradigms

2023-11-22 · Aditi Jha, Sam Havens, Jeremey Dohmann, Alex Trott 외

Large Language Models are traditionally finetuned on large instruction datasets. However recent studies suggest that small, high-quality datasets can suffice for general purpose instruction following. This lack of consen…

Instruction Following

LLaVA-MoLE: Sparse Mixture of LoRA Experts for Mitigating Data Conflicts in Instruction Finetuning MLLMs

2024-01-29 · Shaoxiang Chen, Zequn Jie, Lin Ma

Instruction finetuning on a variety of image-text instruction data is the key to obtaining a versatile Multimodal Large Language Model (MLLM), and different configurations of the instruction data can lead to finetuned mo…

Language ModellingLarge Language ModelMixture-of-ExpertsMultimodal Large Language Model

SMART: Submodular Data Mixture Strategy for Instruction Tuning

2024-03-13 · H S V N S Kowndinya Renduchintala, Sumit Bhatia, Ganesh Ramakrishnan

Instruction Tuning involves finetuning a language model on a collection of instruction-formatted datasets in order to enhance the generalizability of the model to unseen tasks. Studies have shown the importance of balanc…

Language ModelingLanguage Modelling

COIG-CQIA: Quality is All You Need for Chinese Instruction Fine-tuning

2024-03-26 · Yuelin Bai, Xinrun Du, Yiming Liang, Yonggang Jin 외

Remarkable progress on English instruction tuning has facilitated the efficacy and reliability of large language models (LLMs). However, there remains a noticeable gap in instruction tuning for Chinese, where the complex…

All

An Empirical Study of Scaling Instruct-Tuned Large Multimodal Models

2023-09-18 · Yadong Lu, Chunyuan Li, Haotian Liu, Jianwei Yang 외

Visual instruction tuning has recently shown encouraging progress with open-source large multimodal models (LMM) such as LLaVA and MiniGPT-4. However, most existing studies of open-source LMM are performed using models w…

Visual Question Answering