Diachronic Embeddings for People in the News
Previous English-language diachronic change models based on word embeddings have typically used single tokens to represent entities, including names of people. This leads to issues with both ambiguity (resulting in one embedding representing several distinct and unrelated people) and unlinked references (leading to several distinct embeddings which represent the same person). In this paper, we show that using named entity recognition and heuristic name linking steps before training a diachronic embedding model leads to more accurate representations of references to people, as compared to the token-only baseline. In large news corpus of articles from The Guardian, we provide examples of several types of analysis that can be performed using these new embeddings. Further, we show that real world events and context changes can be detected using our proposed model.
Code (0)
등록된 구현이 없습니다.
Tasks
Articlesnamed-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)Word EmbeddingsSimilar Papers 제목 키워드 기반
Using Word Embeddings to Quantify Ethnic Stereotypes in 12 years of Spanish News
The current study provides a diachronic analysis of the stereotypical portrayals concerning seven of the most prominent foreign nationalities living in Spain in a Spanish news outlet. We use 12 years (2007-2018) of news …
ArticlesWord EmbeddingsCharacterizing Linguistic Shifts in Croatian News via Diachronic Word Embeddings
Measuring how semantics of words change over time improves our understanding of how cultures and perspectives change. Diachronic word embeddings help us quantify this shift, although previous studies leveraged substantia…
ArticlesDiachronic Word EmbeddingsSentiment AnalysisWord EmbeddingsLeveraging Contextual Embeddings for Detecting Diachronic Semantic Shift
We propose a new method that leverages contextual embeddings for the task of diachronic semantic shift detection by generating time specific word representations from BERT embeddings. The results of our experiments in th…
Domain AdaptationSemantic Shift DetectionOne-to-X analogical reasoning on word embeddings: a case for diachronic armed conflict prediction from news texts
We extend the well-known word analogy task to a one-to-X formulation, including one-to-none cases, when no correct answer exists. The task is cast as a relation discovery problem and applied to historical armed conflicts…
Word EmbeddingsTemporal Word Analogies: Identifying Lexical Replacement with Diachronic Word Embeddings
This paper introduces the concept of temporal word analogies: pairs of words which occupy the same semantic space at different points in time. One well-known property of word embeddings is that they are able to effective…
ArticlesDiachronic Word EmbeddingsWord Embeddings