The Impact of Word Representations on Sequential Neural MWE Identification
Recent initiatives such as the PARSEME shared task allowed the rapid development of MWE identification systems. Many of those are based on recent NLP advances, using neural sequence models that take continuous word representations as input. We study two related questions in neural MWE identification: (a) the use of lemmas and/or surface forms as input features, and (b) the use of word-based or character-based embeddings to represent them. Our experiments on Basque, French, and Polish show that character-based representations yield systematically better results than word-based ones. In some cases, character-based representations of surface forms can be used as a proxy for lemmas, depending on the morphological complexity of the language.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Word Representations, Tree Models and Syntactic Functions
Word representations induced from models with discrete latent variables (e.g.\ HMMs) have been shown to be beneficial in many NLP applications. In this work, we exploit labeled syntactic dependency trees and formalize th…
named-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)Representation LearningBig Data Small Data, In Domain Out-of Domain, Known Word Unknown Word: The Impact of Word Representation on Sequence Labelling Tasks
Word embeddings -- distributed word representations that can be learned from unlabelled data -- have been shown to have high utility in many natural language processing applications. In this paper, we perform an extrinsi…
ChunkingNERPOSPOS Tagging+2Sequential Modelling of the Evolution of Word Representations for Semantic Change Detection
Semantic change detection concerns the task of identifying words whose meaning has changed over time. Current state-of-the-art approaches operating on neural embeddings detect the level of semantic change in a word by co…
Change DetectionLabel-Enhanced Hierarchical Contextualized Representation for Sequential Metaphor Identification
Recent metaphor identification approaches mainly consider the contextual text features within a sentence or introduce external linguistic features to the model. But they usually ignore the extra information that the data…
Language ModelingLanguage ModellingSentenceEnhancing Representation Generalization in Authorship Identification
Authorship identification ascertains the authorship of texts whose origins remain undisclosed. That authorship identification techniques work as reliably as they do has been attributed to the fact that authorial style is…
Domain Generalization