paper-with-me

Papers

Probing and Fine-tuning Reading Comprehension Models for Few-shot Event Extraction

2020-10-21 · Rui Feng, Jie Yuan, Chao Zhang

We study the problem of event extraction from text data, which requires both detecting target event types and their arguments. Typically, both the event detection and argument detection subtasks are formulated as supervised sequence labeling problems. We argue that the event extraction models so trained are inherently label-hungry, and can generalize poorly across domains and text genres.We propose a reading comprehension framework for event extraction.Specifically, we formulate event detection as a textual entailment prediction problem, and argument detection as a question answer-ing problem. By constructing proper query templates, our approach can effectively distill rich knowledge about tasks and label semantics from pretrained reading comprehension models. Moreover, our model can be fine-tuned with a small amount of data to boost its performance. Our experiment results show that our method performs strongly for zero-shot and few-shot event extraction, and it achieves state-of-the-art performance on the ACE 2005 benchmark when trained with full supervision.

📄 PDF Abstract BibTeX arXiv:2010.11325

Code (0)

등록된 구현이 없습니다.

Tasks

Event DetectionEvent ExtractionNatural Language InferenceReading Comprehension

Similar Papers 제목 키워드 기반

A Pairwise Probe for Understanding BERT Fine-Tuning on Machine Reading Comprehension

2020-06-02 · Jie Cai, Zhengzhou Zhu, Ping Nie, Qian Liu

Pre-trained models have brought significant improvements to many NLP tasks and have been extensively analyzed. But little is known about the effect of fine-tuning on specific tasks. Intuitively, people may agree that a p…

Boundary Detectioncoreference-resolutionCoreference ResolutionMachine Reading Comprehension+1

Family Matters: Language Transfer and Merging for Adapting Small LLMs to Faroese

2025-10-01 · Jenny Kunz, Iben Nyholm Debess, Annika Simonsen arxiv

We investigate strategies for adapting small, efficient language models to Faroese, a low-resource North Germanic language. Starting from English-pretrained models, we apply continued pre-training on related Scandinavian…

Linguistic AcceptabilityReading Comprehension

Forget Me Not: Reducing Catastrophic Forgetting for Domain Adaptation in Reading Comprehension

2019-11-01 · Y. Xu, X. Zhong, A. J. J. Yepes, J. H. Lau

The creation of large-scale open domain reading comprehension data sets in recent years has enabled the development of end-to-end neural comprehension models with promising results. To use these models for domains with l…

Domain AdaptationReading Comprehension

STARC: Structured Annotations for Reading Comprehension

2020-04-30 · ACL 2020 6 · Yevgeni Berzak, Jonathan Malmaud, Roger Levy

We present STARC (Structured Annotations for Reading Comprehension), a new annotation framework for assessing reading comprehension with multiple choice questions. Our framework introduces a principled structure for the …

Multiple-choiceReading Comprehension

Task Transfer and Domain Adaptation for Zero-Shot Question Answering

2022-06-14 · DeepLo 2022 7 · Xiang Pan, Alex Sheng, David Shimshoni, Aditya Singhal 외

Pretrained language models have shown success in various areas of natural language processing, including reading comprehension tasks. However, when applying machine learning methods to new domains, labeled data may not a…

Domain AdaptationQuestion AnsweringReading Comprehension