Comparing Two Basic Methods for Discriminating Between Similar Languages and Varieties
This article describes the systems submitted by the Citius{\_}Ixa{\_}Imaxin team to the Discriminating Similar Languages Shared Task 2016. The systems are based on two different strategies: classification with ranked dictionaries and Naive Bayes classifiers. The results of the evaluation show that ranking dictionaries are more sound and stable across different domains while basic bayesian models perform reasonably well on in-domain datasets, but their performance drops when they are applied on out-of-domain texts.
Code (0)
등록된 구현이 없습니다.
Tasks
Automatic Speech Recognition (ASR)General ClassificationLanguage IdentificationSpeech RecognitionVocal Bursts Valence PredictionSimilar Papers 제목 키워드 기반
Short Text Language Identification for Under Resourced Languages
The paper presents a hierarchical naive Bayesian and lexicon based classifier for short text language identification (LID) useful for under resourced languages. The algorithm is evaluated on short pieces of text for the …
Language IdentificationHigher Criticism for Discriminating Word-Frequency Tables and Testing Authorship
We adapt the Higher Criticism (HC) goodness-of-fit test to measure the closeness between word-frequency tables. We apply this measure to authorship attribution challenges, where the goal is to identify the author of a do…
Authorship AttributionDiscriminating Similar Languages: Evaluations and Explorations
We present an analysis of the performance of machine learning classifiers on discriminating between similar languages and language varieties. We carried out a number of experiments using the results of the two editions o…
BIG-bench Machine LearningDiscriminating between Similar Languages with Word-level Convolutional Neural Networks
Discriminating between Similar Languages (DSL) is a challenging task addressed at the VarDial Workshop series. We report on our participation in the DSL shared task with a two-stage system. In the first stage, character …
Language IdentificationQuestion AnsweringText ClassificationASIREM Participation at the Discriminating Similar Languages Shared Task 2016
This paper presents the system built by ASIREM team for the Discriminating between Similar Languages (DSL) Shared task 2016. It describes the system which uses character-based and word-based n-grams separately. ASIREM pa…
Dialect IdentificationLanguage IdentificationTask 2