GRIT: Generative Role-filler Transformers for Document-level Event Entity Extraction
We revisit the classic problem of document-level role-filler entity extraction (REE) for template filling. We argue that sentence-level approaches are ill-suited to the task and introduce a generative transformer-based encoder-decoder framework (GRIT) that is designed to model context at the document level: it can make extraction decisions across sentence boundaries; is implicitly aware of noun phrase coreference structure, and has the capacity to respect cross-role dependencies in the template structure. We evaluate our approach on the MUC-4 dataset, and show that our model performs substantially better than prior work. We also show that our modeling choices contribute to model performance, e.g., by implicitly capturing linguistic knowledge such as recognizing coreferent entity mentions.
Code (2)
Tasks
DecoderRole-filler Entity ExtractionSentenceSimilar Papers 제목 키워드 기반
Template Filling with Generative Transformers
Template filling is generally tackled by a pipeline of two separate supervised systems {--} one for role-filler extraction and another for template/event recognition. Since pipelines consider events in isolation, they ca…
Reconstructing Event Regions for Event Extraction via Graph Attention Networks
Event information is usually scattered across multiple sentences within a document. The local sentence-level event extractors often yield many noisy event role filler extractions in the absence of a broader view of the d…
Event ExtractionGraph AttentionSentenceDocument-Level Event Role Filler Extraction using Multi-Granularity Contextualized Encoding
Few works in the literature of event extraction have gone beyond individual sentences to make extraction decisions. This is problematic when the information needed to recognize an event argument is spread across multiple…
Document-level Event ExtractionEvent ExtractionLanguage ModelingLanguage Modelling+1Enriching Transformers with Structured Tensor-Product Representations for Abstractive Summarization
Abstractive summarization, the task of generating a concise summary of input documents, requires: (1) reasoning over the source document to determine the salient pieces of information scattered across the long document, …
Abstractive Text SummarizationDocument-level Entity-based Extraction as Template Generation
Document-level entity-based extraction (EE), aiming at extracting entity-centric information such as entity roles and entity relations, is key to automatic knowledge acquisition from text corpora for various domains. Mos…
4-ary Relation ExtractionBinary Relation ExtractionRole-filler Entity Extraction