Deep Learning Architecture for Complex Word Identification
We describe a system for the CWI-task that includes information on 5 aspects of the (complex) lexical item, namely distributional information of the item itself, morphological structure, psychological measures, corpus-counts and topical information. We constructed a deep learning architecture that combines those features and apply it to the probabilistic and binary classification task for all English sets and Spanish. We achieved reasonable performance on all sets with best performances seen on the probabilistic task, particularly on the English news set (MAE 0.054 and F1-score of 0.872). An analysis of the results shows that reasonable performance can be achieved with a single architecture without any domain-specific tweaking of the parameter settings and that distributional features capture almost all of the information also found in hand-crafted features.
Code (0)
등록된 구현이 없습니다.
Tasks
AllBinary ClassificationComplex Word IdentificationDeep LearningGeneral ClassificationLexical SimplificationSimilar Papers 제목 키워드 기반
Identification of Multiword Expressions in Tweets for Hate Speech Detection
Multiword expression (MWE) identification in tweets is a complex task due to the complex linguistic nature of MWEs combined with the non-standard language use in social networks. MWE features were shown to be helpful for…
Hate Speech DetectionVerbal Multiword Expressions for Identification of Metaphor
Metaphor is a linguistic device in which a concept is expressed by mentioning another. Identifying metaphorical expressions, therefore, requires a non-compositional understanding of semantics. Multiword Expressions (MWEs…
Multilingual Complex Word Identification: Convolutional Neural Networks with Morphological and Linguistic Features
The paper is about our experiments with Complex Word Identification system using deep learning approach with word embeddings and engineered features.
Complex Word IdentificationDeep LearningWord EmbeddingsCLexIS2: A New Corpus for Complex Word Identification Research in Computing Studies
Reading is a complex process not only because of the words or sections that are difficult for the reader to understand. Complex word identification (CWI) is the task of detecting in the content of documents the words tha…
Complex Word IdentificationLexical SimplificationLanguage Identification in Code-Mixed Data using Multichannel Neural Networks and Context Capture
An accurate language identification tool is an absolute necessity for building complex NLP systems to be used on code-mixed data. Lot of work has been recently done on the same, but there's still room for improvement. In…
Language Identification