A Comprehensive Empirical Evaluation of Existing Word Embedding Approaches
Vector-based word representations help countless Natural Language Processing (NLP) tasks capture the language's semantic and syntactic regularities. In this paper, we present the characteristics of existing word embedding approaches and analyze them with regard to many classification tasks. We categorize the methods into two main groups - Traditional approaches mostly use matrix factorization to produce word representations, and they are not able to capture the semantic and syntactic regularities of the language very well. On the other hand, Neural-network-based approaches can capture sophisticated regularities of the language and preserve the word relationships in the generated word representations. We report experimental results on multiple classification tasks and highlight the scenarios where one approach performs better than the rest.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
How to (Properly) Evaluate Cross-Lingual Word Embeddings: On Strong Baselines, Comparative Analyses, and Some Misconceptions
Cross-lingual word embeddings (CLEs) enable multilingual modeling of meaning and facilitate cross-lingual transfer of NLP models. Despite their ubiquitous usage in downstream tasks, recent increasingly popular projection…
Bilingual Lexicon InductionCross-Lingual TransferCross-Lingual Word EmbeddingsMisconceptions+1CogniFNN: A Fuzzy Neural Network Framework for Cognitive Word Embedding Evaluation
Word embeddings can reflect the semantic representations, and the embedding qualities can be comprehensively evaluated with human natural reading-related cognitive data sources. In this paper, we proposed the CogniFNN fr…
EEGElectroencephalogram (EEG)Embeddings EvaluationWord EmbeddingsWord Embedding Evaluation for Sinhala
This paper presents the first ever comprehensive evaluation of different types of word embeddings for Sinhala language. Three standard word embedding models, namely, Word2Vec (both Skipgram and CBOW), FastText, and Glove…
Part-Of-Speech TaggingPOSPOS TaggingSentiment Analysis+1Learning and Evaluating Chinese Idiom Embeddings
We study the task of learning and evaluating Chinese idiom embeddings. We first construct a new evaluation dataset that contains idiom synonyms and antonyms. Observing that existing Chinese word embedding methods may not…
Word Embedding Algorithms as Generalized Low Rank Models and their Canonical Form
Word embedding algorithms produce very reliable feature representations of words that are used by neural network models across a constantly growing multitude of NLP tasks. As such, it is imperative for NLP practitioners …
FormNews ClassificationPOSPOS Tagging+1