When Simple n-gram Models Outperform Syntactic Approaches: Discriminating between Dutch and Flemish
In this paper we present the results of our participation in the Discriminating between Dutch and Flemish in Subtitles VarDial 2018 shared task. We try techniques proven to work well for discriminating between language varieties as well as explore the potential of using syntactic features, i.e. hierarchical syntactic subtrees. We experiment with different combinations of features. Discriminating between these two languages turned out to be a very hard task, not only for a machine: human performance is only around 0.51 F1 score; our best system is still a simple Naive Bayes model with word unigrams and bigrams. The system achieved an F1 score (macro) of 0.62, which ranked us 4th in the shared task.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
A Simple and Accurate Syntax-Agnostic Neural Model for Dependency-based Semantic Role Labeling
We introduce a simple and accurate neural model for dependency-based semantic role labeling. Our model predicts predicate-argument dependencies relying on states of a bidirectional LSTM encoder. The semantic role labeler…
Semantic Role LabelingCode2Snapshot: Using Code Snapshots for Learning Representations of Source Code
There are several approaches for encoding source code in the input vectors of neural models. These approaches attempt to include various syntactic and semantic features of input programs in their encoding. In this paper,…
Code ClassificationMethod name predictionDirectional Skip-Gram: Explicitly Distinguishing Left and Right Context for Word Embeddings
In this paper, we present directional skip-gram (DSG), a simple but effective enhancement of the skip-gram model by explicitly distinguishing left and right context in word prediction. In doing so, a direction vector is …
Learning Word EmbeddingsPart-Of-Speech TaggingWord EmbeddingsWord SimilaritySyntactic Learnability of Echo State Neural Language Models at Scale
What is a neural model with minimum architectural complexity that exhibits reasonable language learning capability? To explore such a simple but sufficient neural language model, we revisit a basic reservoir computing (R…
Language ModelingLanguage ModellingA Topological Approach to Compare Document Semantics Based on a New Variant of Syntactic N-grams
This paper delivers a new perspective of thinking and utilizing syntactic n-grams (sn-grams). Sn-grams are a type of non-linear n-grams which have been playing a critical role in many NLP tasks. Introducing sn-grams to c…
Clustering