Evaluating Word Embedding Hyper-Parameters for Similarity and Analogy Tasks
The versatility of word embeddings for various applications is attracting researchers from various fields. However, the impact of hyper-parameters when training embedding model is often poorly understood. How much do hyper-parameters such as vector dimensions and corpus size affect the quality of embeddings, and how do these results translate to downstream applications? Using standard embedding evaluation metrics and datasets, we conduct a study to empirically measure the impact of these hyper-parameters.
Code (0)
등록된 구현이 없습니다.
Tasks
Word EmbeddingsSimilar Papers 제목 키워드 기반
Evaluating Word Embeddings on Low-Resource Languages
The analogy task introduced by Mikolov et al. (2013) has become the standard metric for tuning the hyperparameters of word embedding models. In this paper, however, we argue that the analogy task is unsuitable for low-re…
Model SelectionWord EmbeddingsDense Embeddings Preserving the Semantic Relationships in WordNet
In this paper, we provide a novel way to generate low dimensional vector embeddings for the noun and verb synsets in WordNet, where the hypernym-hyponym relationship is preserved in the embeddings. We call this embedding…
Towards Lower Bounds on Number of Dimensions for Word Embeddings
Word embeddings are a relatively new addition to the modern NLP researcher{'}s toolkit. However, unlike other tools, word embeddings are used in a black box manner. There are very few studies regarding various hyperparam…
Named Entity Recognition (NER)Part-Of-Speech TaggingSarcasm DetectionSentence Classification+2Comparison of Paragram and GloVe Results for Similarity Benchmarks
Distributional Semantics Models(DSM) derive word space from linguistic items in context. Meaning is obtained by defining a distance measure between vectors corresponding to lexical entities. Such vectors present several …
Semantic SimilaritySemantic Textual SimilarityWord EmbeddingsSyntactic Interchangeability in Word Embedding Models
Nearest neighbors in word embedding models are commonly observed to be semantically similar, but the relations between them can vary greatly. We investigate the extent to which word embedding models preserve syntactic in…
POSvalidWord Similarity