paper-with-me

홈 › Papers

Contextualized Cross-Lingual Event Trigger Extraction with Minimal Resources

2019-11-01 · CONLL 2019 11 · Meryem M{'}hamdi, Marjorie Freedman, Jonathan May

Event trigger extraction is an information extraction task of practical utility, yet it is challenging due to the difficulty of disambiguating word sense meaning. Previous approaches rely extensively on hand-crafted language-specific features and are applied mainly to English for which annotated datasets and Natural Language Processing (NLP) tools are available. However, the availability of such resources varies from one language to another. Recently, contextualized Bidirectional Encoder Representations from Transformers (BERT) models have established state-of-the-art performance for a variety of NLP tasks. However, there has not been much effort in exploring language transfer using BERT for event extraction. In this work, we treat event trigger extraction as a sequence tagging problem and propose a cross-lingual framework for training it without any hand-crafted features. We experiment with different flavors of transfer learning from high-resourced to low-resourced languages and compare the performance of different multilingual embeddings for event trigger extraction. Our results show that training in a multilingual setting outperforms language-specific models for both English and Chinese. Our work is the first to experiment with two event architecture variants in a cross-lingual setting, to show the effectiveness of contextualized embeddings obtained using BERT, and to explore and analyze its performance on Arabic.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

Event ExtractionTransfer Learning

Methods 이 논문이 사용한 방법론

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Residual Connection 설명 없음
Attention Dropout Attention Dropout is a type of dropout used in attention-based architectures, where elements are randomly dropped out of the…
Linear Warmup With Linear Decay Linear Warmup With Linear Decay is a learning rate schedule in which we increase the learning rate linearly for $n$ updates and then linearly decay afterwards.
Weight Decay 설명 없음
Refunds@Expedia|||How do I get a full refund from Expedia? “How do I get a full refund from Expedia? How do I get a full refund from Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Quick Help &…
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Adam 설명 없음

Similar Papers 제목 키워드 기반

Cross-lingual Structure Transfer for Relation and Event Extraction

2019-11-01 · IJCNLP 2019 11 · Ananya Subburathinam, Di Lu, Heng Ji, Jonathan May 외

The identification of complex semantic structures such as events and entity relations, already a challenging Information Extraction task, is doubly difficult from sources written in under-resourced and under-annotated la…

Event ExtractionRelationRelation Extraction

Generating Uncontextualized and Contextualized Questions for Document-Level Event Argument Extraction

2024-04-07 · Md Nayem Uddin, Enfa Rose George, Eduardo Blanco, Steven Corman

This paper presents multiple question generation strategies for document-level event argument extraction. These strategies do not require human involvement and result in uncontextualized questions as well as contextualiz…

Event Argument ExtractionQuestion GenerationQuestion-Generation

A Joint Neural Model for Information Extraction with Global Features

2020-07-01 · ACL 2020 6 · Ying Lin, Heng Ji, Fei Huang, Lingfei Wu

Most existing joint neural models for Information Extraction (IE) use local task-specific classifiers to predict labels for individual instances (e.g., trigger, relation) regardless of their interactions. For example, a …

DecoderSentence

Leveraging Multilingual Training for Limited Resource Event Extraction

2016-12-01 · COLING 2016 12 · Andrew Hsi, Yiming Yang, Jaime Carbonell, Ruochen Xu

Event extraction has become one of the most important topics in information extraction, but to date, there is very limited work on leveraging cross-lingual training to boost performance. We propose a new event extraction…

Dependency ParsingEvent Argument ExtractionEvent ExtractionMachine Translation+2

Language Model Priming for Cross-Lingual Event Extraction

2021-09-25 · Steven Fincke, Shantanu Agarwal, Scott Miller, Elizabeth Boschee

We present a novel, language-agnostic approach to "priming" language models for the task of event extraction, providing particularly effective performance in low-resource and zero-shot cross-lingual settings. With primin…

Event ExtractionLanguage ModelingLanguage Modellingmodel+1