Zero-shot Triplet Extraction by Template Infilling
The task of triplet extraction aims to extract pairs of entities and their corresponding relations from unstructured text. Most existing methods train an extraction model on training data involving specific target relations, and are incapable of extracting new relations that were not observed at training time. Generalizing the model to unseen relations typically requires fine-tuning on synthetic training data which is often noisy and unreliable. We show that by reducing triplet extraction to a template infilling task over a pre-trained language model (LM), we can equip the extraction model with zero-shot learning capabilities and eliminate the need for additional training data. We propose a novel framework, ZETT (ZEro-shot Triplet extraction by Template infilling), that aligns the task objective to the pre-training objective of generative transformers to generalize to unseen relations. Experiments on FewRel and Wiki-ZSL datasets demonstrate that ZETT shows consistent and stable performance, outperforming previous state-of-the-art methods, even when using automatically generated templates. https://github.com/megagonlabs/zett/
Code (1)
Tasks
Data AugmentationLanguage ModelingLanguage ModellingTripletZero-Shot LearningZero-shot Relation Triplet ExtractionSimilar Papers 제목 키워드 기반
RelationPrompt: Leveraging Prompts to Generate Synthetic Data for Zero-Shot Relation Triplet Extraction
Despite the importance of relation extraction in building and representing knowledge, less research is focused on generalizing to unseen relations types. We introduce the task setting of Zero-Shot Relation Triplet Extrac…
Language ModelingLanguage ModellingRelationRelation Classification+5Small Models Are (Still) Effective Cross-Domain Argument Extractors
Effective ontology transfer has been a major goal of recent work on event argument extraction (EAE). Two methods in particular -- question answering (QA) and template infilling (TI) -- have emerged as promising approache…
Event Argument ExtractionQuestion AnsweringSentenceDon't Prompt, Search! Mining-based Zero-Shot Learning with Language Models
Masked language models like BERT can perform text classification in a zero-shot fashion by reformulating downstream tasks as text infilling. However, this approach is highly sensitive to the template used to prompt the m…
Text ClassificationText InfillingZero-Shot LearningZero-Shot Text ClassificationMASTE: A Multi-Agent Pipeline for Zero-Shot Aspect Sentiment Triplet Extraction
Aspect Sentiment Triplet Extraction (ASTE) requires jointly identifying (aspect, opinion, sentiment) triples from a given review sentence. While large language models (LLMs) achieve strong zero-shot performance on many N…
Aspect Sentiment Triplet ExtractionPre-training to Match for Unified Low-shot Relation Extraction
Low-shot relation extraction~(RE) aims to recognize novel relations with very few or even no samples, which is critical in real scenario application. Few-shot and zero-shot RE are two representative low-shot RE tasks, wh…
Meta-LearningRelationRelation ExtractionTriplet