paper-with-me

Papers

Textual Entailment for Event Argument Extraction: Zero- and Few-Shot with Multi-Source Learning

2022-05-03 · Findings (NAACL) 2022 7 · Oscar Sainz, Itziar Gonzalez-Dios, Oier Lopez de Lacalle, Bonan Min, Eneko Agirre

Recent work has shown that NLP tasks such as Relation Extraction (RE) can be recasted as Textual Entailment tasks using verbalizations, with strong performance in zero-shot and few-shot settings thanks to pre-trained entailment models. The fact that relations in current RE datasets are easily verbalized casts doubts on whether entailment would be effective in more complex tasks. In this work we show that entailment is also effective in Event Argument Extraction (EAE), reducing the need of manual annotation to 50% and 20% in ACE and WikiEvents respectively, while achieving the same performance as with full training. More importantly, we show that recasting EAE as entailment alleviates the dependency on schemas, which has been a road-block for transferring annotations between domains. Thanks to the entailment, the multi-source transfer between ACE and WikiEvents further reduces annotation down to 10% and 5% (respectively) of the full training without transfer. Our analysis shows that the key to good results is the use of several entailment datasets to pre-train the entailment model. Similar to previous approaches, our method requires a small amount of effort for manual verbalization: only less than 15 minutes per event argument type is needed, and comparable results can be achieved with users with different level of expertise.

📄 PDF Abstract BibTeX arXiv:2205.01376

Code (1)

osainz59/Ask2Transformers 공식 구현 pytorch

Tasks

Event Argument ExtractionNatural Language InferenceRelation ExtractionZero-shot Named Entity Recognition (NER)

Methods 이 논문이 사용한 방법론

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Position-Wise Feed-Forward Layer 설명 없음
Residual Connection 설명 없음
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Adam 설명 없음

Similar Papers 제목 키워드 기반

Probing and Fine-tuning Reading Comprehension Models for Few-shot Event Extraction

2020-10-21 · Rui Feng, Jie Yuan, Chao Zhang

We study the problem of event extraction from text data, which requires both detecting target event types and their arguments. Typically, both the event detection and argument detection subtasks are formulated as supervi…

Event DetectionEvent ExtractionNatural Language InferenceReading Comprehension

Learning to Generate and Extract: A Multi-Agent Collaboration Framework For Zero-shot Document-level Event Arguments Extraction

2026-03-03 · Guangjun Zhang, Hu Zhang, Yazhou Han, Yue Fan 외 arxiv

Document-level event argument extraction (DEAE) is essential for knowledge acquisition, aiming to extract participants of events from documents . In the zero-shot setting, existing methods employ LLMs to generate synthet…

Reinforcement Learning

Event-Arguments Extraction Corpus and Modeling using BERT for Arabic

2024-07-30 · Alaa Aljabari, Lina Duaibes, Mustafa Jarrar, Mohammed Khalilia

Event-argument extraction is a challenging task, particularly in Arabic due to sparse linguistic resources. To fill this gap, we introduce the \hadath corpus ($550$k tokens) as an extension of Wojood, enriched with event…

Event Argument ExtractionEvent Relation ExtractionRelationRelation Extraction

Improving Zero-Shot Event Extraction via Sentence Simplification

2022-04-06 · Sneha Mehta, Huzefa Rangwala, Naren Ramakrishnan

The success of sites such as ACLED and Our World in Data have demonstrated the massive utility of extracting events in structured formats from large volumes of textual data in the form of news, social media, blogs and di…

Event Argument ExtractionEvent ExtractionExtractive Question-AnsweringMachine Reading Comprehension+4

Zero-shot Event Extraction via Transfer Learning: Challenges and Insights

2021-08-01 · ACL 2021 5 · Qing Lyu, Hongming Zhang, Elior Sulem, Dan Roth

Event extraction has long been a challenging task, addressed mostly with supervised methods that require expensive annotation and are not extensible to new event ontologies. In this work, we explore the possibility of ze…

Event ExtractionNatural Language InferenceQuestion AnsweringTransfer Learning+1