Probing and Fine-tuning Reading Comprehension Models for Few-shot Event Extraction
We study the problem of event extraction from text data, which requires both detecting target event types and their arguments. Typically, both the event detection and argument detection subtasks are formulated as supervised sequence labeling problems. We argue that the event extraction models so trained are inherently label-hungry, and can generalize poorly across domains and text genres.We propose a reading comprehension framework for event extraction.Specifically, we formulate event detection as a textual entailment prediction problem, and argument detection as a question answer-ing problem. By constructing proper query templates, our approach can effectively distill rich knowledge about tasks and label semantics from pretrained reading comprehension models. Moreover, our model can be fine-tuned with a small amount of data to boost its performance. Our experiment results show that our method performs strongly for zero-shot and few-shot event extraction, and it achieves state-of-the-art performance on the ACE 2005 benchmark when trained with full supervision.
Code (0)
등록된 구현이 없습니다.
Tasks
Event DetectionEvent ExtractionNatural Language InferenceReading ComprehensionSimilar Papers 제목 키워드 기반
A Pairwise Probe for Understanding BERT Fine-Tuning on Machine Reading Comprehension
Pre-trained models have brought significant improvements to many NLP tasks and have been extensively analyzed. But little is known about the effect of fine-tuning on specific tasks. Intuitively, people may agree that a p…
Boundary Detectioncoreference-resolutionCoreference ResolutionMachine Reading Comprehension+1Family Matters: Language Transfer and Merging for Adapting Small LLMs to Faroese
We investigate strategies for adapting small, efficient language models to Faroese, a low-resource North Germanic language. Starting from English-pretrained models, we apply continued pre-training on related Scandinavian…
Linguistic AcceptabilityReading ComprehensionForget Me Not: Reducing Catastrophic Forgetting for Domain Adaptation in Reading Comprehension
The creation of large-scale open domain reading comprehension data sets in recent years has enabled the development of end-to-end neural comprehension models with promising results. To use these models for domains with l…
Domain AdaptationReading ComprehensionSTARC: Structured Annotations for Reading Comprehension
We present STARC (Structured Annotations for Reading Comprehension), a new annotation framework for assessing reading comprehension with multiple choice questions. Our framework introduces a principled structure for the …
Multiple-choiceReading ComprehensionTask Transfer and Domain Adaptation for Zero-Shot Question Answering
Pretrained language models have shown success in various areas of natural language processing, including reading comprehension tasks. However, when applying machine learning methods to new domains, labeled data may not a…
Domain AdaptationQuestion AnsweringReading Comprehension