An Artificial Language Evaluation of Distributional Semantic Models
Recent studies of distributional semantic models have set up a competition between word embeddings obtained from predictive neural networks and word vectors obtained from abstractive count-based models. This paper is an attempt to reveal the underlying contribution of additional training data and post-processing steps on each type of model in word similarity and relatedness inference tasks. We do so by designing an artificial language framework, training a predictive and a count-based model on data sampled from this grammar, and evaluating the resulting word vectors in paradigmatic and syntagmatic tasks defined with respect to the grammar.
Code (0)
등록된 구현이 없습니다.
Tasks
Word EmbeddingsWord SimilaritySimilar Papers 제목 키워드 기반
Polish evaluation dataset for compositional distributional semantics models
The paper presents a procedure of building an evaluation dataset. for the validation of compositional distributional semantics models estimated for languages other than English. The procedure generally builds on steps de…
Semantic CompositionSentenceLearning Functional Distributional Semantics with Visual Data
Functional Distributional Semantics is a recently proposed framework for learning distributional semantics that provides linguistic interpretability. It models the meaning of a word as a binary classifier rather than a n…
Language AcquisitionLearning Functional Distributional Semantics with Visual Data
Functional Distributional Semantics is a recently proposed framework for learning distributional semantics that provides linguistic interpretability. It models the meaning of a word as a binary classifier rather than a n…
Language AcquisitionAre LLMs Models of Distributional Semantics? A Case Study on Quantifiers
Distributional semantics is the linguistic theory that a word's meaning can be derived from its distribution in natural language (i.e., its use). Language models are commonly viewed as an implementation of distributional…
Semantic Holism and Word Representations in Artificial Neural Networks
Artificial neural networks are a state-of-the-art solution for many problems in natural language processing. What can we learn about language and meaning from the way artificial neural networks represent it? Word represe…