How Well Do Embedding Models Capture Non-compositionality? A View from Multiword Expressions
In this paper, we apply various embedding methods on multiword expressions to study how well they capture the nuances of non-compositional data. Our results from a pool of word-, character-, and document-level embbedings suggest that Word2vec performs the best, followed by FastText and Infersent. Moreover, we find that recently-proposed contextualised embedding models such as Bert and ELMo are not adept at handling non-compositionality in multiword expressions.
Code (0)
등록된 구현이 없습니다.
Methods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
A Comparative Study of Embedding Models in Predicting the Compositionality of Multiword Expressions
In this paper, we perform a comparative evaluation of off-the-shelf embedding models over the task of compositionality prediction of multiword expressions(``MWEs''). Our experimental results suggest that character- and d…
Information RetrievalRepresentation LearningWord EmbeddingsDo Character-Level Neural Network Language Models Capture Knowledge of Multiword Expression Compositionality?
In this paper, we propose the first model for multiword expression (MWE) compositionality prediction based on character-level neural network language models. Experimental results on two kinds of MWEs (noun compounds and …
Machine TranslationPredictionDetecting Unseen Multiword Expressions in American Sign Language
Multiword expressions present unique challenges in many translation tasks. In an attempt to ultimately apply a multiword expression detection system to the translation of American Sign Language, we built and tested two s…
TranslationWord EmbeddingsA Word Embedding Approach to Predicting the Compositionality of Multiword Expressions
On the Compositionality Prediction of Noun Phrases using Poincaré Embeddings
The compositionality degree of multiword expressions indicates to what extent the meaning of a phrase can be derived from the meaning of its constituents and their grammatical relations. Prediction of (non)-compositional…