Distributional Semantics in the Real World: Building Word Vector Representations from a Truth-Theoretic Model
Distributional semantics models (DSMs) are known to produce excellent representations of word meaning, which correlate with a range of behavioural data. As lexical representations, they have been said to be fundamentally different from truth-theoretic models of semantics, where meaning is defined as a correspondence relation to the world. There are two main aspects to this difference: a) DSMs are built over corpus data which may or may not reflect {}what is in the world{'}; b) they are built from word co-occurrences, that is, from lexical types rather than entities and sets. In this paper, we inspect the properties of a distributional model built over a set-theoretic approximation of {}the real world{'}. To achieve this, we take the annotation a large database of images marked with objects, attributes and relations, convert the data into a representation akin to first-order logic and build several distributional models using various combinations of features. We evaluate those models over both relatedness and similarity datasets, demonstrating their effectiveness in standard evaluations. This allows us to conclude that, despite prior claims, truth-theoretic models are good candidates for building graded lexical representations of meaning.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Polish evaluation dataset for compositional distributional semantics models
The paper presents a procedure of building an evaluation dataset. for the validation of compositional distributional semantics models estimated for languages other than English. The procedure generally builds on steps de…
Semantic CompositionSentenceSemantic Composition via Probabilistic Model Theory
Semantic composition remains an open problem for vector space models of semantics. In this paper, we explain how the probabilistic graphical model used in the framework of Functional Distributional Semantics can be inter…
modelSemantic CompositionWord SimilarityCombined Distributional and Logical Semantics
We introduce a new approach to semantics which combines the benefits of distributional and formal logical semantics. Distributional models have been successful in modelling the meanings of content words, but logical sema…
ClusteringQuestion AnsweringRelation ExtractionSentenceBuilding Web-Interfaces for Vector Semantic Models with the WebVectors Toolkit
In this demo we present WebVectors, a free and open-source toolkit helping to deploy web services which demonstrate and visualize distributional semantic models (widely known as word embeddings). WebVectors can be useful…
Machine TranslationNamed Entity Recognition (NER)Sentiment AnalysisWord EmbeddingsA Typedriven Vector Semantics for Ellipsis with Anaphora using Lambek Calculus with Limited Contraction
We develop a vector space semantics for verb phrase ellipsis with anaphora using type-driven compositional distributional semantics based on the Lambek calculus with limited contraction (LCC) of J\"ager (2006). Distribut…
SentenceWord Embeddings