An Exploration of Prompt-Based Zero-Shot Relation Extraction Method
Zero-shot relation extraction is an important method for dealing with the newly emerging relations in the real world which lacks labeled data. However, the current zero-shot methods usually rely on large-scale and in-domain labeled data of predefined relations. In this work, we view zero-shot relation extraction as a semantic match task optimized by prompt-tuning, which maintains a high generalization ability when using even one labeled data in per predefined relations. Specifically, we reduce the dependence on labeled data of predefined relation with the help of the existing knowledge in the pretrained language model (PLMs). To induce this knowledge, we fuse the original input with the prompt template to formulate a cloze-style task, which is consistent with the pretraining stage. The induced knowledge facilitates new relation discovery when large-scale labeled data are not available. Experiment results on two academic datasets show that our method achieves similar performance with only 0.05\% labeled data of pre-defined relations, compared with current state-of-the-art method. Using all labeled data, our method improves the F1 score by nearly 30\% and 9\% on the two datasets respectively.
Code (0)
등록된 구현이 없습니다.
Tasks
Language ModelingLanguage ModellingRelationRelation ExtractionSimilar Papers 제목 키워드 기반
An Exploration of Prompt-Based Zero-Shot Relation Extraction Method
“Zero-shot relation extraction is an important method for dealing with the newly emerging relations in the real world which lacks labeled data. However, the mainstream two-tower zero-shot methods usually rely on large-sc…
Language ModelingLanguage ModellingRelationRelation ExtractionRelationPrompt: Leveraging Prompts to Generate Synthetic Data for Zero-Shot Relation Triplet Extraction
Despite the importance of relation extraction in building and representing knowledge, less research is focused on generalizing to unseen relations types. We introduce the task setting of Zero-Shot Relation Triplet Extrac…
Language ModelingLanguage ModellingRelationRelation Classification+5Unleashing the Power of Large Language Models in Zero-shot Relation Extraction via Self-Prompting
Recent research in zero-shot Relation Extraction (RE) has focused on using Large Language Models (LLMs) due to their impressive zero-shot capabilities. However, current methods often perform suboptimally, mainly due to a…
DiversityIn-Context LearningRelationRelation ExtractionZero-shot Temporal Relation Extraction with ChatGPT
The goal of temporal relation extraction is to infer the temporal relation between two events in the document. Supervised models are dominant in this task. In this work, we investigate ChatGPT's ability on zero-shot temp…
RelationRelation ExtractionTemporal Relation ExtractionRevisiting Large Language Models as Zero-shot Relation Extractors
Relation extraction (RE) consistently involves a certain degree of labeled or unlabeled data even if under zero-shot setting. Recent studies have shown that large language models (LLMs) transfer well to new tasks out-of-…
Question AnsweringRelationRelation Extraction