paper-with-me

홈 › Papers

C-ICL: Contrastive In-context Learning for Information Extraction

2024-02-17 · Ying Mo, Jiahao Liu, Jian Yang, Qifan Wang, Shun Zhang, Jingang Wang, Zhoujun Li

There has been increasing interest in exploring the capabilities of advanced large language models (LLMs) in the field of information extraction (IE), specifically focusing on tasks related to named entity recognition (NER) and relation extraction (RE). Although researchers are exploring the use of few-shot information extraction through in-context learning with LLMs, they tend to focus only on using correct or positive examples for demonstration, neglecting the potential value of incorporating incorrect or negative examples into the learning process. In this paper, we present c-ICL, a novel few-shot technique that leverages both correct and incorrect sample constructions to create in-context learning demonstrations. This approach enhances the ability of LLMs to extract entities and relations by utilizing prompts that incorporate not only the positive samples but also the reasoning behind them. This method allows for the identification and correction of potential interface errors. Specifically, our proposed method taps into the inherent contextual information and valuable information in hard negative samples and the nearest positive neighbors to the test and then applies the in-context learning demonstrations based on LLMs. Our experiments on various datasets indicate that c-ICL outperforms previous few-shot in-context learning methods, delivering substantial enhancements in performance across a broad spectrum of related tasks. These improvements are noteworthy, showcasing the versatility of our approach in miscellaneous scenarios.

📄 PDF Abstract BibTeX arXiv:2402.11254

Code (0)

등록된 구현이 없습니다.

Tasks

In-Context LearningMiscellaneousnamed-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)NERRelation Extraction

Methods 이 논문이 사용한 방법론

Focus 설명 없음

Similar Papers 제목 키워드 기반

COFFEE: A Contrastive Oracle-Free Framework for Event Extraction

2023-03-25 · Meiru Zhang, Yixuan Su, Zaiqiao Meng, Zihao Fu 외

Event extraction is a complex information extraction task that involves extracting events from unstructured text. Prior classification-based methods require comprehensive entity annotations for joint training, while newe…

Event Extraction

Shapley Value-based Contrastive Alignment for Multimodal Information Extraction

2024-07-25 · Wen Luo, Yu Xia, Shen Tianshu, Sujian Li

The rise of social media and the exponential growth of multimodal communication necessitates advanced techniques for Multimodal Information Extraction (MIE). However, existing methodologies primarily rely on direct Image…

Contrastive LearningDescriptive

Improving Long Tailed Document-Level Relation Extraction via Easy Relation Augmentation and Contrastive Learning

2022-05-21 · Yangkai Du, Tengfei Ma, Lingfei Wu, Yiming Wu 외

Towards real-world information extraction scenario, research of relation extraction is advancing to document-level relation extraction(DocRE). Existing approaches for DocRE aim to extract relation by encoding various inf…

Contrastive LearningDocument-level Relation ExtractionRelationRelation Extraction

HiCLRE: A Hierarchical Contrastive Learning Framework for Distantly Supervised Relation Extraction

2022-02-27 · Findings (ACL) 2022 5 · Dongyang Li, Taolin Zhang, Nan Hu, Chengyu Wang 외

Distant supervision assumes that any sentence containing the same entity pairs reflects identical relationships. Previous works of distantly supervised relation extraction (DSRE) task generally focus on sentence-level or…

Contrastive LearningData AugmentationRelationRelation Extraction+1

Multi-view Feature Extraction based on Triple Contrastive Heads

2023-03-22 · Hongjie Zhang

Multi-view feature extraction is an efficient approach for alleviating the issue of dimensionality in highdimensional multi-view data. Contrastive learning (CL), which is a popular self-supervised learning method, has re…

Contrastive LearningSelf-Supervised Learning