paper-with-me

홈 › Papers

A Survey on Data Selection for LLM Instruction Tuning

2024-02-04 · Jiahao Wang, Bolin Zhang, Qianlong Du, Jiajun Zhang, Dianhui Chu

Instruction tuning is a vital step of training large language models (LLM), so how to enhance the effect of instruction tuning has received increased attention. Existing works indicate that the quality of the dataset is more crucial than the quantity during instruction tuning of LLM. Therefore, recently a lot of studies focus on exploring the methods of selecting high-quality subset from instruction datasets, aiming to reduce training costs and enhance the instruction-following capabilities of LLMs. This paper presents a comprehensive survey on data selection for LLM instruction tuning. Firstly, we introduce the wildly used instruction datasets. Then, we propose a new taxonomy of the data selection methods and provide a detailed introduction of recent advances,and the evaluation strategies and results of data selection methods are also elaborated in detail. Finally, we emphasize the open challenges and present new frontiers of this task.

📄 PDF Abstract BibTeX arXiv:2402.05123

Code (1)

bolin97/awesome-instruction-selector 공식 구현

Tasks

Instruction FollowingSurvey

Methods 이 논문이 사용한 방법론

Focus 설명 없음

Similar Papers 제목 키워드 기반

Unleashing the Power of Data Tsunami: A Comprehensive Survey on Data Assessment and Selection for Instruction Tuning of Language Models

2024-08-04 · Yulei Qin, Yuncheng Yang, Pengcheng Guo, Gang Li 외

Instruction tuning plays a critical role in aligning large language models (LLMs) with human preference. Despite the vast amount of open instruction datasets, naively training a LLM on all existing instructions may not b…

Instruction Tuning for Large Language Models: A Survey

2023-08-21 · Shengyu Zhang, Linfeng Dong, Xiaoya Li, Sen Zhang 외

This paper surveys research works in the quickly advancing field of instruction tuning (IT), which can also be referred to as supervised fine-tuning (SFT)\footnote{In this paper, unless specified otherwise, supervised fi…

Survey

RAISE: Reinforenced Adaptive Instruction Selection For Large Language Models

2025-04-09 · Lv Qingsong, Yangning Li, Zihua Lan, Zishan Xu 외

In the instruction fine-tuning of large language models (LLMs), it has become a consensus that a few high-quality instructions are superior to a large number of low-quality instructions. At present, many instruction sele…

Sequential Decision Making

ROSE: A Reward-Oriented Data Selection Framework for LLM Task-Specific Instruction Tuning

2024-12-01 · Yang Wu, Huayi Zhang, Yizheng Jiao, Lin Ma 외

Instruction tuning has underscored the significant potential of large language models (LLMs) in producing more human-controllable and effective outputs in various domains. In this work, we focus on the data selection pro…

Diversity Measurement and Subset Selection for Instruction Tuning Datasets

2024-02-04 · Peiqi Wang, Yikang Shen, Zhen Guo, Matthew Stallone 외

We aim to select data subsets for the fine-tuning of large language models to more effectively follow instructions. Prior work has emphasized the importance of diversity in dataset curation but relied on heuristics such …

DiversityInstruction FollowingPoint Processes