Complex Word Identification Using Character n-grams

2018-06-01 · WS 2018 6 · Maja Popovi{\'c}

This paper investigates the use of character n-gram frequencies for identifying complex words in English, German and Spanish texts. The approach is based on the assumption that complex words are likely to contain different character sequences than simple words. The multinomial Naive Bayes classifier was used with n-grams of different lengths as features, and the best results were obtained for the combination of 2-grams and 4-grams. This variant was submitted to the Complex Word Identification Shared Task 2018 for all texts and achieved F-scores between 70{\%} and 83{\%}. The system was ranked in the middle range for all English texts, as third of fourteen submissions for German, and as tenth of seventeen submissions for Spanish. The method is not very convenient for the cross-language task, achieving only 59{\%} on the French text.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

Complex Word IdentificationLexical SimplificationMachine Translation Text Classification

CIC-FBK Approach to Native Language Identification

2017-09-01 · WS 2017 9 · Ilia Markov, Lingzhen Chen, Carlo Strapparava, Grigori Sidorov

We present the CIC-FBK system, which took part in the Native Language Identification (NLI) Shared Task 2017. Our approach combines features commonly used in previous NLI research, i.e., word n-grams, lemma n-grams, part-…

General Classification Language Identification LEMMA Native Language Identification

Native Language Identification Using a Mixture of Character and Word N-grams

2017-09-01 · WS 2017 9 · Elham Mohammadi, Hadi Veisi, Hessam Amini

Native language identification (NLI) is the task of determining an author{'}s native language, based on a piece of his/her writing in a second language. In recent years, NLI has received much attention due to its challen…

Language Acquisition Language Identification Native Language Identification

UnibucKernel: A kernel-based learning method for complex word identification

2018-03-20 · WS 2018 6 · Andrei M. Butnaru, Radu Tudor Ionescu

In this paper, we present a kernel-based learning approach for the 2018 Complex Word Identification (CWI) Shared Task. Our approach is based on combining multiple low-level features, such as character n-grams, with high-…

Binary Classification Complex Word Identification regression Word Embeddings

A study of N-gram and Embedding Representations for Native Language Identification

2017-09-01 · WS 2017 9 · Sowmya Vajjala, Sagnik Banerjee

We report on our experiments with N-gram and embedding based feature representations for Native Language Identification (NLI) as a part of the NLI Shared Task 2017 (team name: NLI-ISU). Our best performing system on the …

Feature Engineering Language Acquisition Language Identification Native Language Identification+1

Simple But Not Na\"\ive: Fine-Grained Arabic Dialect Identification Using Only N-Grams

2019-08-01 · WS 2019 8 · Sohaila Eltanbouly, May Bashendy, Tamer Elsayed

This paper presents the participation of Qatar University team in MADAR shared task, which addresses the problem of sentence-level fine-grained Arabic Dialect Identification over 25 different Arabic dialects in addition …

Dialect Identification Sentence