paper-with-me

Papers

EasyInstruct: An Easy-to-use Instruction Processing Framework for Large Language Models

2024-02-05 · Yixin Ou, Ningyu Zhang, Honghao Gui, Ziwen Xu, Shuofei Qiao, Yida Xue, Runnan Fang, Kangwei Liu, Lei LI, Zhen Bi, Guozhou Zheng, Huajun Chen

In recent years, instruction tuning has gained increasing attention and emerged as a crucial technique to enhance the capabilities of Large Language Models (LLMs). To construct high-quality instruction datasets, many instruction processing approaches have been proposed, aiming to achieve a delicate balance between data quantity and data quality. Nevertheless, due to inconsistencies that persist among various instruction processing methods, there is no standard open-source instruction processing implementation framework available for the community, which hinders practitioners from further developing and advancing. To facilitate instruction processing research and development, we present EasyInstruct, an easy-to-use instruction processing framework for LLMs, which modularizes instruction generation, selection, and prompting, while also considering their combination and interaction. EasyInstruct is publicly released and actively maintained at https://github.com/zjunlp/EasyInstruct, along with an online demo app and a demo video for quick-start, calling for broader research centered on instruction data and synthetic data.

📄 PDF Abstract BibTeX arXiv:2402.03049

Code (3)

zjunlp/easyinstruct 공식 구현
zjunlp/knowlm 공식 구현 pytorch
zjunlp/cama pytorch

Similar Papers 제목 키워드 기반

When Do Program-of-Thoughts Work for Reasoning?

2023-08-29 · Zhen Bi, Ningyu Zhang, Yinuo Jiang, Shumin Deng 외

In the realm of embodied artificial intelligence, the reasoning capabilities of Large Language Models (LLMs) play a pivotal role. Although there are effective methods like program-of-thought prompting for LLMs which uses…

Code GenerationMathematical Reasoning

EASYTOOL: Enhancing LLM-based Agents with Concise Tool Instruction

2024-01-11 · Siyu Yuan, Kaitao Song, Jiangjie Chen, Xu Tan 외

To address intricate real-world tasks, there has been a rising interest in tool utilization in applications of large language models (LLMs). To develop LLM-based agents, it usually requires LLMs to understand many tool f…

Jellyfish: A Large Language Model for Data Preprocessing

2023-12-04 · Haochen Zhang, Yuyang Dong, Chuan Xiao, Masafumi Oyamada

This paper explores the utilization of LLMs for data preprocessing (DP), a crucial step in the data mining pipeline that transforms raw data into a clean format conducive to easy processing. Whereas the use of LLMs has s…

GPUImputationLanguage ModelingLanguage Modelling+1

EasyNLP: A Comprehensive and Easy-to-use Toolkit for Natural Language Processing

2022-04-30 · Chengyu Wang, Minghui Qiu, Chen Shi, Taolin Zhang 외

The success of Pre-Trained Models (PTMs) has reshaped the development of Natural Language Processing (NLP). Yet, it is not easy to obtain high-performing models and deploy them online for industrial practitioners. To bri…

Few-Shot LearningKnowledge Distillation

EasyV2V: A High-quality Instruction-based Video Editing Framework

2025-12-18 · Jinjie Mai, Chaoyang Wang, Guocheng Gordon Qian, Willi Menapace 외 arxiv

While image editing has advanced rapidly, video editing remains less explored, facing challenges in consistency, control, and generalization. We study the design space of data, architecture, and control, and introduce \e…

Image Editing