Evaluating Composition Models for Verb Phrase Elliptical Sentence Embeddings
Ellipsis is a natural language phenomenon where part of a sentence is missing and its information must be recovered from its surrounding context, as in {``}Cats chase dogs and so do foxes.{''}. Formal semantics has different methods for resolving ellipsis and recovering the missing information, but the problem has not been considered for distributional semantics, where words have vector embeddings and combinations thereof provide embeddings for sentences. In elliptical sentences these combinations go beyond linear as copying of elided information is necessary. In this paper, we develop different models for embedding VP-elliptical sentences. We extend existing verb disambiguation and sentence similarity datasets to ones containing elliptical phrases and evaluate our models on these datasets for a variety of non-linear combinations and their linear counterparts. We compare results of these compositional models to state of the art holistic sentence encoders. Our results show that non-linear addition and a non-linear tensor-based composition outperform the naive non-compositional baselines and the linear models, and that sentence encoders perform well on sentence similarity, but not on verb disambiguation.
Code (1)
Tasks
SentenceSentence EmbeddingsSentence SimilaritySimilar Papers 제목 키워드 기반
Synthetic Dataset for Evaluating Complex Compositional Knowledge for Natural Language Inference
We introduce a synthetic dataset called Sentences Involving Complex Compositional Knowledge (SICCK) and a novel analysis that investigates the performance of Natural Language Inference (NLI) models to understand composit…
Natural Language InferenceNegationSemantic CompositionSentenceEvaluating Neural Word Representations in Tensor-Based Compositional Settings
We provide a comparative study between neural word representations and traditional vector spaces based on co-occurrence counts, in a number of compositional tasks. We use three different semantic spaces and implement sev…
SentenceSentence SimilarityWord EmbeddingsRule-Based Detection of Clausal Coordinate Ellipsis
With our experiment, we show how we can detect and annotate clausal coordinate ellipsis with Constraint Grammar rules. We focus on such an elliptical structure in which there are two coordinated clauses, and the latter o…
Morphological AnalysisSentenceClassical Copying versus Quantum Entanglement in Natural Language: The Case of VP-ellipsis
This paper compares classical copying and quantum entanglement in natural language by considering the case of verb phrase (VP) ellipsis. VP ellipsis is a non-linear linguistic phenomenon that requires the reuse of resour…
Adaptive Joint Learning of Compositional and Non-Compositional Phrase Embeddings
We present a novel method for jointly learning compositional and non-compositional phrase embeddings by adaptively weighting both types of embeddings using a compositionality scoring function. The scoring function is use…