paper-with-me

Papers

Detecting Ongoing Events Using Contextual Word and Sentence Embeddings

2020-07-02 · Mariano Maisonnave, Fernando Delbianco, Fernando Tohmé, Ana Maguitman, Evangelos Milios

This paper introduces the Ongoing Event Detection (OED) task, which is a specific Event Detection task where the goal is to detect ongoing event mentions only, as opposed to historical, future, hypothetical, or other forms or events that are neither fresh nor current. Any application that needs to extract structured information about ongoing events from unstructured texts can take advantage of an OED system. The main contribution of this paper are the following: (1) it introduces the OED task along with a dataset manually labeled for the task; (2) it presents the design and implementation of an RNN model for the task that uses BERT embeddings to define contextual word and contextual sentence embeddings as attributes, which to the best of our knowledge were never used before for detecting ongoing events in news; (3) it presents an extensive empirical evaluation that includes (i) the exploration of different architectures and hyperparameters, (ii) an ablation test to study the impact of each attribute, and (iii) a comparison with a replication of a state-of-the-art model. The results offer several insights into the importance of contextual embeddings and indicate that the proposed approach is effective in the OED task, outperforming the baseline models.

📄 PDF Abstract BibTeX arXiv:2007.01379

Code (0)

등록된 구현이 없습니다.

Tasks

AttributeEvent DetectionQuestion AnsweringSentenceSentence EmbeddingsTask 2Text Summarization

Methods 이 논문이 사용한 방법론

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Multi-Head Attention 설명 없음
Residual Connection 설명 없음
Attention 설명 없음
Attention Dropout Attention Dropout is a type of dropout used in attention-based architectures, where elements are randomly dropped out of the…
Weight Decay 설명 없음
Adam 설명 없음
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…

Similar Papers 제목 키워드 기반

Bi-ISCA: Bidirectional Inter-Sentence Contextual Attention Mechanism for Detecting Sarcasm in User Generated Noisy Short Text

2020-11-23 · Prakamya Mishra, Saroj Kaushik, Kuntal Dey

Many online comments on social media platforms are hateful, humorous, or sarcastic. The sarcastic nature of these comments (especially the short ones) alters their actual implied sentiments, which leads to misinterpretat…

Sarcasm DetectionSentenceSentiment Analysis

MICE: Mining Idioms with Contextual Embeddings

2020-08-13 · Tadej Škvorc, Polona Gantar, Marko Robnik-Šikonja

Idiomatic expressions can be problematic for natural language processing applications as their meaning cannot be inferred from their constituting words. A lack of successful methodological approaches and sufficiently lar…

Cross-Lingual TransferWord Embeddings

Detecting Cybersecurity Events from Noisy Short Text

2019-04-10 · NAACL 2019 6 · Semih Yagcioglu, Mehmet Saygin Seyfioglu, Begum Citamak, Batuhan Bardak 외

It is very critical to analyze messages shared over social networks for cyber threat intelligence and cyber-crime prevention. In this study, we propose a method that leverages both domain-specific word embeddings and tas…

2kWord Embeddings

Exploiting Global Contextual Information for Document-level Named Entity Recognition

2021-06-02 · Zanbo Wang, Wei Wei, Xianling Mao, Shanshan Feng 외

Most existing named entity recognition (NER) approaches are based on sequence labeling models, which focus on capturing the local context dependencies. However, the way of taking one sentence as input prevents the modeli…

named-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)NER+1

EnrichEvent: Enriching Social Data with Contextual Information for Emerging Event Extraction

2023-07-29 · Mohammadali Sefidi Esfahani, Mohammad Akbari

Social platforms have emerged as crucial platforms for disseminating information and discussing real-life social events, offering researchers an excellent opportunity to design and implement novel event detection framewo…

Event DetectionEvent Extraction