Geographical Evaluation of Word Embeddings
Word embeddings are commonly compared either with human-annotated word similarities or through improvements in natural language processing tasks. We propose a novel principle which compares the information from word embeddings with reality. We implement this principle by comparing the information in the word embeddings with geographical positions of cities. Our evaluation linearly transforms the semantic space to optimally fit the real positions of cities and measures the deviation between the position given by word embeddings and the real position. A set of well-known word embeddings with state-of-the-art results were evaluated. We also introduce a visualization that helps with error analysis.
Code (0)
등록된 구현이 없습니다.
Tasks
Machine TranslationNamed Entity Recognition (NER)PositionSentiment AnalysisWord EmbeddingsSimilar Papers 제목 키워드 기반
Geological Inference from Textual Data using Word Embeddings
This research explores the use of Natural Language Processing (NLP) techniques to locate geological resources, with a specific focus on industrial minerals. By using word embeddings trained with the GloVe model, we extra…
BenchmarkingWord EmbeddingsGeographically-Balanced Gigaword Corpora for 50 Language Varieties
While text corpora have been steadily increasing in overall size, even very large corpora are not designed to represent global population demographics. For example, recent work has shown that existing English gigaword co…
Word EmbeddingsTemporal dynamics of semantic relations in word embeddings: an application to predicting armed conflict participants
This paper deals with using word embedding models to trace the temporal dynamics of semantic relations between pairs of words. The set-up is similar to the well-known analogies task, but expanded with a time dimension. T…
Word EmbeddingsMethodical Evaluation of Arabic Word Embeddings
Many unsupervised learning techniques have been proposed to obtain meaningful representations of words from text. In this study, we evaluate these various techniques when used to generate Arabic word embeddings. We first…
Document ClassificationLearning Word EmbeddingsNamed Entity Recognition (NER)Word EmbeddingsWord-Alignment-Based Segment-Level Machine Translation Evaluation using Word Embeddings
One of the most important problems in machine translation (MT) evaluation is to evaluate the similarity between translation hypotheses with different surface forms from the reference, especially at the segment level. We …
Machine TranslationTranslationWord AlignmentWord Embeddings