C-ICL: Contrastive In-context Learning for Information Extraction
There has been increasing interest in exploring the capabilities of advanced large language models (LLMs) in the field of information extraction (IE), specifically focusing on tasks related to named entity recognition (NER) and relation extraction (RE). Although researchers are exploring the use of few-shot information extraction through in-context learning with LLMs, they tend to focus only on using correct or positive examples for demonstration, neglecting the potential value of incorporating incorrect or negative examples into the learning process. In this paper, we present c-ICL, a novel few-shot technique that leverages both correct and incorrect sample constructions to create in-context learning demonstrations. This approach enhances the ability of LLMs to extract entities and relations by utilizing prompts that incorporate not only the positive samples but also the reasoning behind them. This method allows for the identification and correction of potential interface errors. Specifically, our proposed method taps into the inherent contextual information and valuable information in hard negative samples and the nearest positive neighbors to the test and then applies the in-context learning demonstrations based on LLMs. Our experiments on various datasets indicate that c-ICL outperforms previous few-shot in-context learning methods, delivering substantial enhancements in performance across a broad spectrum of related tasks. These improvements are noteworthy, showcasing the versatility of our approach in miscellaneous scenarios.
Code (0)
등록된 구현이 없습니다.
Tasks
In-Context LearningMiscellaneousnamed-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)NERRelation ExtractionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
COFFEE: A Contrastive Oracle-Free Framework for Event Extraction
Event extraction is a complex information extraction task that involves extracting events from unstructured text. Prior classification-based methods require comprehensive entity annotations for joint training, while newe…
Event ExtractionShapley Value-based Contrastive Alignment for Multimodal Information Extraction
The rise of social media and the exponential growth of multimodal communication necessitates advanced techniques for Multimodal Information Extraction (MIE). However, existing methodologies primarily rely on direct Image…
Contrastive LearningDescriptiveImproving Long Tailed Document-Level Relation Extraction via Easy Relation Augmentation and Contrastive Learning
Towards real-world information extraction scenario, research of relation extraction is advancing to document-level relation extraction(DocRE). Existing approaches for DocRE aim to extract relation by encoding various inf…
Contrastive LearningDocument-level Relation ExtractionRelationRelation ExtractionHiCLRE: A Hierarchical Contrastive Learning Framework for Distantly Supervised Relation Extraction
Distant supervision assumes that any sentence containing the same entity pairs reflects identical relationships. Previous works of distantly supervised relation extraction (DSRE) task generally focus on sentence-level or…
Contrastive LearningData AugmentationRelationRelation Extraction+1Multi-view Feature Extraction based on Triple Contrastive Heads
Multi-view feature extraction is an efficient approach for alleviating the issue of dimensionality in highdimensional multi-view data. Contrastive learning (CL), which is a popular self-supervised learning method, has re…
Contrastive LearningSelf-Supervised Learning