paper-with-me

Papers

Zero-shot Triplet Extraction by Template Infilling

2022-12-21 · Bosung Kim, Hayate Iso, Nikita Bhutani, Estevam Hruschka, Ndapa Nakashole, Tom Mitchell

The task of triplet extraction aims to extract pairs of entities and their corresponding relations from unstructured text. Most existing methods train an extraction model on training data involving specific target relations, and are incapable of extracting new relations that were not observed at training time. Generalizing the model to unseen relations typically requires fine-tuning on synthetic training data which is often noisy and unreliable. We show that by reducing triplet extraction to a template infilling task over a pre-trained language model (LM), we can equip the extraction model with zero-shot learning capabilities and eliminate the need for additional training data. We propose a novel framework, ZETT (ZEro-shot Triplet extraction by Template infilling), that aligns the task objective to the pre-training objective of generative transformers to generalize to unseen relations. Experiments on FewRel and Wiki-ZSL datasets demonstrate that ZETT shows consistent and stable performance, outperforming previous state-of-the-art methods, even when using automatically generated templates. https://github.com/megagonlabs/zett/

📄 PDF Abstract BibTeX arXiv:2212.10708

Code (1)

megagonlabs/zett 공식 구현 pytorch

Tasks

Data AugmentationLanguage ModelingLanguage ModellingTripletZero-Shot LearningZero-shot Relation Triplet Extraction

Similar Papers 제목 키워드 기반

RelationPrompt: Leveraging Prompts to Generate Synthetic Data for Zero-Shot Relation Triplet Extraction

2022-03-17 · Findings (ACL) 2022 5 · Yew Ken Chia, Lidong Bing, Soujanya Poria, Luo Si

Despite the importance of relation extraction in building and representing knowledge, less research is focused on generalizing to unseen relations types. We introduce the task setting of Zero-Shot Relation Triplet Extrac…

Language ModelingLanguage ModellingRelationRelation Classification+5

Small Models Are (Still) Effective Cross-Domain Argument Extractors

2024-04-12 · William Gantt, Aaron Steven White

Effective ontology transfer has been a major goal of recent work on event argument extraction (EAE). Two methods in particular -- question answering (QA) and template infilling (TI) -- have emerged as promising approache…

Event Argument ExtractionQuestion AnsweringSentence

Don't Prompt, Search! Mining-based Zero-Shot Learning with Language Models

2022-10-26 · Mozes van de Kar, Mengzhou Xia, Danqi Chen, Mikel Artetxe

Masked language models like BERT can perform text classification in a zero-shot fashion by reformulating downstream tasks as text infilling. However, this approach is highly sensitive to the template used to prompt the m…

Text ClassificationText InfillingZero-Shot LearningZero-Shot Text Classification

MASTE: A Multi-Agent Pipeline for Zero-Shot Aspect Sentiment Triplet Extraction

2026-07-09 · Ao Hong, Lehang Wang, Zhirun Yue, Mingxin Wang 외 arxiv

Aspect Sentiment Triplet Extraction (ASTE) requires jointly identifying (aspect, opinion, sentiment) triples from a given review sentence. While large language models (LLMs) achieve strong zero-shot performance on many N…

Aspect Sentiment Triplet Extraction

Pre-training to Match for Unified Low-shot Relation Extraction

2022-03-23 · ACL 2022 5 · Fangchao Liu, Hongyu Lin, Xianpei Han, Boxi Cao 외

Low-shot relation extraction~(RE) aims to recognize novel relations with very few or even no samples, which is critical in real scenario application. Few-shot and zero-shot RE are two representative low-shot RE tasks, wh…

Meta-LearningRelationRelation ExtractionTriplet