Learning Distributed Word Representations for Natural Logic Reasoning
Natural logic offers a powerful relational conception of meaning that is a natural counterpart to distributed semantic representations, which have proven valuable in a wide range of sophisticated language tasks. However, it remains an open question whether it is possible to train distributed representations to support the rich, diverse logical reasoning captured by natural logic. We address this question using two neural network-based models for learning embeddings: plain neural networks and neural tensor networks. Our experiments evaluate the models' ability to learn the basic algebra of natural logic relations from simulated data and from the WordNet noun graph. The overall positive results are promising for the future of learned distributed representations in the applied modeling of logical semantics.
Code (0)
등록된 구현이 없습니다.
Tasks
Logical ReasoningOpen-Ended Question AnsweringTensor NetworksSimilar Papers 제목 키워드 기반
An Evaluation Dataset for Legal Word Embedding: A Case Study On Chinese Codex
Word embedding is a modern distributed word representations approach widely used in many natural language processing tasks. Converting the vocabulary in a legal document into a word embedding model facilitates subjecting…
Document ClassificationMachine TranslationWord EmbeddingsNLProlog: Reasoning with Weak Unification for Natural Language Question Answering
Symbolic logic allows practitioners to build systems that perform rule-based reasoning which is interpretable and which can easily be augmented with prior knowledge. However, such systems are traditionally difficult to a…
Question AnsweringSentenceKNET: A General Framework for Learning Word Embedding using Morphological Knowledge
Neural network techniques are widely applied to obtain high-quality distributed representations of words, i.e., word embeddings, to address text mining, information retrieval, and natural language processing tasks. Recen…
Information RetrievalRetrievalWord EmbeddingsWord SimilarityMultiVec: a Multilingual and Multilevel Representation Learning Toolkit for NLP
We present MultiVec, a new toolkit for computing continuous representations for text at different granularity levels (word-level or sequences of words). MultiVec includes word2vec{'}s features, paragraph vector (batch an…
Document ClassificationGeneral ClassificationRepresentation LearningSentiment AnalysisNLProlog: Reasoning with Weak Unification for Question Answering in Natural Language
Rule-based models are attractive for various tasks because they inherently lead to interpretable and explainable decisions and can easily incorporate prior knowledge. However, such systems are difficult to apply to probl…
Question AnsweringSentence