Efficient Argument Structure Extraction with Transfer Learning and Active Learning
The automation of extracting argument structures faces a pair of challenges on (1) encoding long-term contexts to facilitate comprehensive understanding, and (2) improving data efficiency since constructing high-quality argument structures is time-consuming. In this work, we propose a novel context-aware Transformer-based argument structure prediction model which, on five different domains, significantly outperforms models that rely on features or only encode limited contexts. To tackle the difficulty of data annotation, we examine two complementary methods: (i) transfer learning to leverage existing annotated data to boost model performance in a new target domain, and (ii) active learning to strategically identify a small amount of samples for annotation. We further propose model-independent sample acquisition strategies, which can be generalized to diverse domains. With extensive experiments, we show that our simple-yet-effective acquisition strategies yield competitive results against three strong comparisons. Combined with transfer learning, substantial F1 score boost (5-25) can be further achieved during the early iterations of active learning across domains.
Code (0)
등록된 구현이 없습니다.
Tasks
Active LearningTransfer LearningSimilar Papers 제목 키워드 기반
Multilingual Generative Language Models for Zero-Shot Cross-Lingual Event Argument Extraction
We present a study on leveraging multilingual pre-trained generative language models for zero-shot cross-lingual event argument extraction (EAE). By formulating EAE as a language generation task, our method effectively e…
Cross-Lingual TransferEvent Argument ExtractionText GenerationZero-Shot Cross-Lingual TransferRetrieval-Augmented Generative Question Answering for Event Argument Extraction
Event argument extraction has long been studied as a sequential prediction problem with extractive-based methods, tackling each argument in isolation. Although recent work proposes generation-based methods to capture cro…
Event Argument ExtractionFew-Shot LearningGenerative Question AnsweringQuestion Answering+1CLIO: Role-interactive Multi-event Head Attention Network for Document-level Event Extraction
Transforming the large amounts of unstructured text on the Internet into structured event knowledge is a critical, yet unsolved goal of NLP, especially when addressing document-level text. Existing methods struggle in Do…
Document-level Event ExtractionEvent ExtractionMultilingual Generative Language Models for Zero-Shot Cross-Lingual Event Argument Extraction
We present a pioneering study on leveraging multilingual pre-trained generative language models for zero-shot cross-lingual event argument extraction (EAE) by formulating EAE as a language generation task. Compared to pr…
Cross-Lingual TransferEvent Argument ExtractionText GenerationCross-lingual Structure Transfer for Relation and Event Extraction
The identification of complex semantic structures such as events and entity relations, already a challenging Information Extraction task, is doubly difficult from sources written in under-resourced and under-annotated la…
Event ExtractionRelationRelation Extraction