paper-with-me

홈 › Papers

In-Context Learning with Noisy Labels

2024-11-29 · Junyong Kang, Donghyun Son, Hwanjun Song, Buru Chang

In-context learning refers to the emerging ability of large language models (LLMs) to perform a target task without additional training, utilizing demonstrations of the task. Recent studies aim to enhance in-context learning performance by selecting more useful demonstrations. However, they overlook the presence of inevitable noisy labels in task demonstrations that arise during the labeling process in the real-world. In this paper, we propose a new task, in-context learning with noisy labels, which aims to solve real-world problems for in-context learning where labels in task demonstrations would be corrupted. Moreover, we propose a new method and baseline methods for the new task, inspired by studies in learning with noisy labels. Through experiments, we demonstrate that our proposed method can serve as a safeguard against performance degradation in in-context learning caused by noisy labels.

📄 PDF Abstract BibTeX arXiv:2411.19581

Code (0)

등록된 구현이 없습니다.

Tasks

In-Context LearningLearning with noisy labels

Similar Papers 제목 키워드 기반

Context-based Virtual Adversarial Training for Text Classification with Noisy Labels

2022-05-29 · LREC 2022 6 · Do-Myoung Lee, Yeachan Kim, Chang-gyun Seo

Deep neural networks (DNNs) have a high capacity to completely memorize noisy labels given sufficient training time, and its memorization, unfortunately, leads to performance degradation. Recently, virtual adversarial tr…

Memorizationtext-classificationText Classification

Exploring the Robustness of In-Context Learning with Noisy Labels

2024-04-28 · Chen Cheng, Xinzhi Yu, Haodong Wen, Jingsong Sun 외

Recently, the mysterious In-Context Learning (ICL) ability exhibited by Transformer architectures, especially in large language models (LLMs), has sparked significant research interest. However, the resilience of Transfo…

Data AugmentationIn-Context LearningLearning with noisy labels

Learning to Generate Diverse Pedestrian Movements from Web Videos with Noisy Labels

2024-10-10 · Zhizheng Liu, Joe Lin, Wayne Wu, Bolei Zhou

Understanding and modeling pedestrian movements in the real world is crucial for applications like motion forecasting and scene simulation. Many factors influence pedestrian movements, such as scene context, individual c…

Motion ForecastingZero-shot Generalization

Fine-Grained Named Entity Typing over Distantly Supervised Data Based on Refined Representations

2020-04-07 · Muhammad Asif Ali, Yifang Sun, Bing Li, Wei Wang

Fine-Grained Named Entity Typing (FG-NET) is a key component in Natural Language Processing (NLP). It aims at classifying an entity mention into a wide range of entity types. Due to a large number of entity types, distan…

Entity TypingSentence

Data Shapley Value for Handling Noisy Labels: An application in Screening COVID-19 Pneumonia from Chest CT Scans

2021-10-17 · Nastaran Enshaei, Moezedin Javad Rafiee, Arash Mohammadi, Farnoosh Naderkhani

A long-standing challenge of deep learning models involves how to handle noisy labels, especially in applications where human lives are at stake. Adoption of the data Shapley Value (SV), a cooperative game theoretical ap…