paper-with-me

홈 › Papers

Empowering Large Language Models for Textual Data Augmentation

2024-04-26 · Yichuan Li, Kaize Ding, Jianling Wang, Kyumin Lee

With the capabilities of understanding and executing natural language instructions, Large language models (LLMs) can potentially act as a powerful tool for textual data augmentation. However, the quality of augmented data depends heavily on the augmentation instructions provided, and the effectiveness can fluctuate across different downstream tasks. While manually crafting and selecting instructions can offer some improvement, this approach faces scalability and consistency issues in practice due to the diversity of downstream tasks. In this work, we address these limitations by proposing a new solution, which can automatically generate a large pool of augmentation instructions and select the most suitable task-informed instructions, thereby empowering LLMs to create high-quality augmented data for different downstream tasks. Empirically, the proposed approach consistently generates augmented data with better quality compared to non-LLM and LLM-based data augmentation methods, leading to the best performance on 26 few-shot learning tasks sourced from a wide range of application domains.

📄 PDF Abstract BibTeX arXiv:2404.17642

Code (0)

등록된 구현이 없습니다.

Tasks

Data AugmentationDiversityFew-Shot Learning

Similar Papers 제목 키워드 기반

Empowering Few-Shot Relation Extraction with The Integration of Traditional RE Methods and Large Language Models

2024-07-12 · Ye Liu, Kai Zhang, Aoran Gan, Linan Yue 외

Few-Shot Relation Extraction (FSRE), a subtask of Relation Extraction (RE) that utilizes limited training instances, appeals to more researchers in Natural Language Processing (NLP) due to its capability to extract textu…

In-Context LearningRelationRelation Extraction

TalkUp: Paving the Way for Understanding Empowering Language

2023-05-23 · Lucille Njoo, Chan Young Park, Octavia Stappart, Marvin Thielk 외

Empowering language is important in many real-world contexts, from education to workplace dynamics to healthcare. Though language technologies are growing more prevalent in these contexts, empowerment has seldom been stu…

Empowering Computing Education Researchers Through LLM-Assisted Content Analysis

2025-08-26 · Laurie Gale, Sebastian Mateos Nicolajsen arxiv

Computing education research (CER) is often instigated by practitioners wanting to improve both their own and the wider discipline's teaching practice. However, the latter is often difficult as many researchers lack the …

Conditional BERT Contextual Augmentation

2018-12-17 · Xing Wu, Shangwen Lv, Liangjun Zang, Jizhong Han 외

We propose a novel data augmentation method for labeled sentences called conditional BERT contextual augmentation. Data augmentation methods are often applied to prevent overfitting and improve generalization of deep neu…

Data AugmentationLanguage ModelingLanguage ModellingText Classification

Soft Contextual Data Augmentation for Neural Machine Translation

2019-05-25 · ACL 2019 7 · Jinhua Zhu, Fei Gao, Lijun Wu, Yingce Xia 외

While data augmentation is an important trick to boost the accuracy of deep learning methods in computer vision tasks, its study in natural language tasks is still very limited. In this paper, we present a novel data aug…

Data AugmentationLanguage ModelingLanguage ModellingMachine Translation+2