paper-with-me

홈 › Papers

Within-Document Event Coreference with BERT-Based Contextualized Representations

2021-02-15 · Shafiuddin Rehan Ahmed, James H. Martin

Event coreference continues to be a challenging problem in information extraction. With the absence of any external knowledge bases for events, coreference becomes a clustering task that relies on effective representations of the context in which event mentions appear. Recent advances in contextualized language representations have proven successful in many tasks, however, their use in event linking been limited. Here we present a three part approach that (1) uses representations derived from a pretrained BERT model to (2) train a neural classifier to (3) drive a simple clustering algorithm to create coreference chains. We achieve state of the art results with this model on two standard datasets for within-document event coreference task and establish a new standard on a third newer dataset.

📄 PDF Abstract BibTeX arXiv:2102.09600

Code (0)

등록된 구현이 없습니다.

Tasks

Clustering

Methods 이 논문이 사용한 방법론

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Linear Warmup With Linear Decay Linear Warmup With Linear Decay is a learning rate schedule in which we increase the learning rate linearly for $n$ updates and then linearly decay afterwards.
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Adam 설명 없음
Multi-Head Attention 설명 없음
Attention Dropout Attention Dropout is a type of dropout used in attention-based architectures, where elements are randomly dropped out of the…
Weight Decay 설명 없음
Residual Connection 설명 없음

Similar Papers 제목 키워드 기반

Event Coreference Resolution Using Neural Network Classifiers

2018-10-09 · Arun Pandian, Lamana Mulaffer, Kemal Oflazer, Amna AlZeyara

This paper presents a neural network classifier approach to detecting both within- and cross- document event coreference effectively using only event mention based features. Our approach does not (yet) rely on any event …

coreference-resolutionCoreference ResolutionCross Document Coreference ResolutionEvent Coreference Resolution+1

Investigating Cross-Document Event Coreference for Dutch

2022-10-01 · COLING (CRAC) 2022 10 · Loic De Langhe, Orphee De Clercq, Veronique Hoste

In this paper we present baseline results for Event Coreference Resolution (ECR) in Dutch using gold-standard (i.e non-predicted) event mentions. A newly developed benchmark dataset allows us to properly investigate the …

coreference-resolutionCoreference ResolutionEvent Coreference Resolution

WEC: Deriving a Large-scale Cross-document Event Coreference dataset from Wikipedia

2021-04-11 · NAACL 2021 4 · Alon Eirew, Arie Cattan, Ido Dagan

Cross-document event coreference resolution is a foundational task for NLP applications involving multi-text processing. However, existing corpora for this task are scarce and relatively small, while annotating only mode…

coreference-resolutionCoreference ResolutionEvent Coreference Resolution

Seeing the Forest and the Trees: Detection and Cross-Document Coreference Resolution of Militarized Interstate Disputes

2020-05-06 · Benjamin J. Radford

Previous efforts to automate the detection of social and political events in text have primarily focused on identifying events described within single sentences or documents. Within a corpus of documents, these automated…

coreference-resolutionCoreference ResolutionCross Document Coreference ResolutionEvent Coreference Resolution

Seeing the Forest and the Trees: Detection and Cross-Document Coreference Resolution of Militarized Interstate Disputes

2020-05-01 · LREC 2020 5 · Benjamin Radford

Previous efforts to automate the detection of social and political events in text have primarily focused on identifying events described within single sentences or documents. Within a corpus of documents, these automated…

coreference-resolutionCoreference ResolutionCross Document Coreference ResolutionEvent Coreference Resolution