paper-with-me

홈 › Papers

Compositional Distributional Semantics with Long Short Term Memory

2015-03-09 · SEMEVAL 2015 6 · Phong Le, Willem Zuidema

We are proposing an extension of the recursive neural network that makes use of a variant of the long short-term memory architecture. The extension allows information low in parse trees to be stored in a memory register (the `memory cell') and used much later higher up in the parse tree. This provides a solution to the vanishing gradient problem and allows the network to capture long range dependencies. Experimental results show that our composition outperformed the traditional neural-network composition on the Stanford Sentiment Treebank.

📄 PDF Abstract BibTeX arXiv:1503.02510

Code (1)

lephong/lstm-rnn

Similar Papers 제목 키워드 기반

Evaluation of Simple Distributional Compositional Operations on Longer Texts

2014-05-01 · LREC 2014 5 · Tamara Polajnar, Laura Rimell, Stephen Clark

Distributional semantic models have been effective at representing linguistic semantics at the word level, and more recently research has moved on to the construction of distributional representations for larger segments…

Semantic Textual SimilaritySentenceSentence segmentation

"Not not bad" is not "bad": A distributional account of negation

2013-06-10 · Karl Moritz Hermann, Edward Grefenstette, Phil Blunsom

With the increasing empirical success of distributional models of compositional semantics, it is timely to consider the types of textual logic that such models are capable of capturing. In this paper, we address shortcom…

Negation

Don't Blame Distributional Semantics if it can't do Entailment

2019-05-17 · WS 2019 5 · Matthijs Westera, Gemma Boleda

Distributional semantics has had enormous empirical success in Computational Linguistics and Cognitive Science in modeling various semantic phenomena, such as semantic similarity, and distributional models are widely use…

Semantic SimilaritySemantic Textual Similarity

Fuzzy Generalised Quantifiers for Natural Language in Categorical Compositional Distributional Semantics

2021-09-23 · Matej Dostal, Mehrnoosh Sadrzadeh, Gijs Wijnholds

Recent work on compositional distributional models shows that bialgebras over finite dimensional vector spaces can be applied to treat generalised quantifiers for natural language. That technique requires one to construc…

A Typedriven Vector Semantics for Ellipsis with Anaphora using Lambek Calculus with Limited Contraction

2019-05-05 · Gijs Wijnholds, Mehrnoosh Sadrzadeh

We develop a vector space semantics for verb phrase ellipsis with anaphora using type-driven compositional distributional semantics based on the Lambek calculus with limited contraction (LCC) of J\"ager (2006). Distribut…

SentenceWord Embeddings