Semi-supervised New Event Type Induction and Description via Contrastive Loss-Enforced Batch Attention
Most event extraction methods have traditionally relied on an annotated set of event types. However, creating event ontologies and annotating supervised training data are expensive and time-consuming. Previous work has proposed semi-supervised approaches which leverage seen (annotated) types to learn how to automatically discover new event types. State-of-the-art methods, both semi-supervised or fully unsupervised, use a form of reconstruction loss on specific tokens in a context. In contrast, we present a novel approach to semi-supervised new event type induction using a masked contrastive loss which learns similarities between event mentions by enforcing an attention mechanism over the data minibatch. We further disentangle the discovered clusters by approximating the underlying manifolds in the data, which allows us to increase normalized mutual information and Fowlkes-Mallows scores by over 20% absolute. Building on these clustering results, we extend our approach to two new tasks: predicting the type name of the discovered clusters and linking them to FrameNet frames.
Code (0)
등록된 구현이 없습니다.
Tasks
Event ExtractionSimilar Papers 제목 키워드 기반
Semi-supervised New Event Type Induction and Description via Contrastive Loss-Enforced Batch Attention
Most event extraction methods have traditionally relied on an annotated set of event types. However, creating event ontologies and annotating supervised training data are expensive and time-consuming. Previous work has p…
Event ExtractionInducing Script Structure from Crowdsourced Event Descriptions via Semi-Supervised Clustering
We present a semi-supervised clustering approach to induce script structure from crowdsourced descriptions of event sequences by grouping event descriptions into paraphrase sets (representing event types) and inducing th…
ClusteringQuestion AnsweringSemantic Role LabelingSemi-supervised New Event Type Induction and Event Detection
Most previous event extraction studies assume a set of target event types and corresponding event annotations are given, which could be very expensive. In this paper, we work on a new task of semi-supervised event type i…
Event DetectionEvent ExtractionVocal Bursts Type PredictionUnsupervised Induction of Contingent Event Pairs from Film Scenes
Human engagement in narrative is partially driven by reasoning about discourse relations between narrative events, and the expectations about what is likely to happen next that results from such reasoning. Researchers in…
Common Sense ReasoningEvent Representation with Sequential, Semi-Supervised Discrete Variables
Within the context of event modeling and understanding, we propose a new method for neural sequence modeling that takes partially-observed sequences of discrete, external knowledge into account. We construct a sequential…