Multiplicative Tree-Structured Long Short-Term Memory Networks for Semantic Representations
Tree-structured LSTMs have shown advantages in learning semantic representations by exploiting syntactic information. Most existing methods model tree structures by bottom-up combinations of constituent nodes using the same shared compositional function and often making use of input word information only. The inability to capture the richness of compositionality makes these models lack expressive power. In this paper, we propose multiplicative tree-structured LSTMs to tackle this problem. Our model makes use of not only word information but also relation information between words. It is more expressive, as different combination functions can be used for each child node. In addition to syntactic trees, we also investigate the use of Abstract Meaning Representation in tree-structured models, in order to incorporate both syntactic and semantic information from the sentence. Experimental results on common NLP tasks show the proposed models lead to better sentence representation and AMR brings benefits in complex tasks.
Code (0)
등록된 구현이 없습니다.
Tasks
Abstract Meaning RepresentationLearning Semantic RepresentationsMachine TranslationRelation ExtractionSentenceSentiment AnalysisText ClassificationSimilar Papers 제목 키워드 기반
Inducing Grammar from Long Short-Term Memory Networks by Shapley Decomposition
The principle of compositionality has deep roots in linguistics: the meaning of an expression is determined by its structure and the meanings of its constituents. However, modern neural network models such as long short-…
Japanese Sentiment Classification using a Tree-Structured Long Short-Term Memory with Attention
Previous approaches to training syntax-based sentiment classification models required phrase-level annotated corpora, which are not readily available in many languages other than English. Thus, we propose the use of tree…
ClassificationGeneral ClassificationSentiment AnalysisSentiment ClassificationImproved Semantic Representations From Tree-Structured Long Short-Term Memory Networks
Because of their superior ability to preserve sequence information over time, Long Short-Term Memory (LSTM) networks, a type of recurrent neural network with a more complex computational unit, have obtained strong result…
General ClassificationSemantic SimilaritySentiment AnalysisSentiment ClassificationAttentive Tree-structured Network for Monotonicity Reasoning
Many state-of-art neural models designed for monotonicity reasoning perform poorly on downward inference. To address this shortcoming, we developed an attentive tree-structured neural network. It consists of a tree-based…
Natural Language InferenceSentenceText Sentiment Analysis based on Fusion of Structural Information and Serialization Information
Tree-structured Long Short-Term Memory (Tree-LSTM) has been proved to be an effective method in the sentiment analysis task. It extracts structural information on text, and uses Long Short-Term Memory (LSTM) cell to prev…
Opinion MiningSentiment Analysis