Do Character-Level Neural Network Language Models Capture Knowledge of Multiword Expression Compositionality?
In this paper, we propose the first model for multiword expression (MWE) compositionality prediction based on character-level neural network language models. Experimental results on two kinds of MWEs (noun compounds and verb-particle constructions) and two languages (English and German) suggest that character-level neural network language models capture knowledge of multiword expression compositionality, in particular for English noun compounds and the particle component of English verb-particle constructions. In contrast to many other approaches to MWE compositionality prediction, this character-level approach does not require token-level identification of MWEs in a training corpus, and can potentially predict the compositionality of out-of-vocabulary MWEs.
Code (0)
등록된 구현이 없습니다.
Tasks
Machine TranslationPredictionSimilar Papers 제목 키워드 기반
A Comparative Study of Embedding Models in Predicting the Compositionality of Multiword Expressions
In this paper, we perform a comparative evaluation of off-the-shelf embedding models over the task of compositionality prediction of multiword expressions(``MWEs''). Our experimental results suggest that character- and d…
Information RetrievalRepresentation LearningWord EmbeddingsHow Well Do Embedding Models Capture Non-compositionality? A View from Multiword Expressions
In this paper, we apply various embedding methods on multiword expressions to study how well they capture the nuances of non-compositional data. Our results from a pool of word-, character-, and document-level embbedings…
Neural Lemmatization of Multiword Expressions
This article focuses on the lemmatization of multiword expressions (MWEs). We propose a deep encoder-decoder architecture generating for every MWE word its corresponding part in the lemma, based on the internal context o…
DecoderLEMMALemmatizationRepresenting Multiword Term Variation in a Terminological Knowledge Base: a Corpus-Based Study
In scientific and technical communication, multiword terms are the most frequent type of lexical units. Rendering them in another language is not an easy task due to their cognitive complexity, the proliferation of diffe…
TranslationThe Romanian Corpus Annotated with Verbal Multiword Expressions
This paper reports on the Romanian journalistic corpus annotated with verbal multiword expressions following the PARSEME guidelines. The corpus is sentence split, tokenized, part-of-speech tagged, lemmatized, syntactical…
DiversitySentence