Modeling Document-Level Context for Event Detection via Important Context Selection
The task of Event Detection (ED) in Information Extraction aims to recognize and classify trigger words of events in text. The recent progress has featured advanced transformer-based language models (e.g., BERT) as a critical component in state-of-the-art models for ED. However, the length limit for input texts is a barrier for such ED models as they cannot encode long-range document-level context that has been shown to be beneficial for ED. To address this issue, we propose a novel method to model document-level context for ED that dynamically selects relevant sentences in the document for the event prediction of the target sentence. The target sentence will be then augmented with the selected sentences and consumed entirely by transformer-based language models for improved representation learning for ED. To this end, the REINFORCE algorithm is employed to train the relevant sentence selection for ED. Several information types are then introduced to form the reward function for the training process, including ED performance, sentence similarity, and discourse relations. Our extensive experiments on multiple benchmark datasets reveal the effectiveness of the proposed model, leading to new state-of-the-art performance.
Code (0)
등록된 구현이 없습니다.
Tasks
Event DetectionRepresentation LearningSentenceSentence SimilaritySimilar Papers 제목 키워드 기반
DGMED: A Novel Document-Level Graph Convolution Network for Multi-Event Detection
Online news documents can contain thousands of characters and tens of events. To detect events in these documents, it is important to construct long-range context information. Such information, however, is not effectivel…
Event DetectionEvent ExtractionSentenceJoint Detection and Coreference Resolution of Entities and Events with Document-level Context Aggregation
Constructing knowledge graphs from unstructured text is an important task that is relevant to many domains. Most previous work focuses on extracting information from sentences or paragraphs, due to the difficulty of anal…
coreference-resolutionCoreference ResolutionKnowledge GraphsSentenceDocument-level Event Extraction with Efficient End-to-end Learning of Cross-event Dependencies
Fully understanding narratives often requires identifying events in the context of whole documents and modeling the event relations. However, document-level event extraction is a challenging task as it requires the extra…
Computational EfficiencyDocument-level Event ExtractionEvent ExtractionInformation Retrieval+3Exploring Sentence Community for Document-Level Event Extraction
Document-level event extraction is critical to various natural language processing tasks for providing structured information. Existing approaches by sequential modeling neglect the complex logic structures for long text…
Community DetectionDocument-level Event ExtractionEvent ExtractionGraph Attention+1Is Killed More Significant than Fled? A Contextual Model for Salient Event Detection
Identifying the key events in a document is critical to holistically understanding its important information. Although measuring the salience of events is highly contextual, most previous work has used a limited represen…
Event Detection