paper-with-me

홈 › Papers

Detecting Clitics Related Orthographic Errors in Turkish

2019-09-01 · RANLP 2019 9 · Ugurcan Arikan, Onur Gungor, Suzan Uskudarli

For the spell correction task, vocabulary based methods have been replaced with methods that take morphological and grammar rules into account. However, such tools are fairly immature, and, worse, non-existent for many low resource languages. Checking only if a word is well-formed with respect to the morphological rules of a language may produce false negatives due to the ambiguity resulting from the presence of numerous homophonic words. In this work, we propose an approach to detect and correct the {``}de/da{''} clitic errors in Turkish text. Our model is a neural sequence tagger trained with a synthetically constructed dataset consisting of positive and negative samples. The model{'}s performance with this dataset is presented according to different word embedding configurations. The model achieved an F1 score of 86.67{\%} on a synthetically constructed dataset. We also compared the model{'}s performance on a manually curated dataset of challenging samples that proved superior to other spelling correctors with 71{\%} accuracy compared to the second-best (Google Docs) with and accuracy of 34{\%}.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Turkish Resources for Visual Word Recognition

2014-05-01 · LREC 2014 5 · Beg{\"u}m Erten, Cem Bozsahin, Deniz Zeyrek

We report two tools to conduct psycholinguistic experiments on Turkish words. KelimetriK allows experimenters to choose words based on desired orthographic scores of word frequency, bigram and trigram frequency, ON, OLD2…

Language ModellingSpeech Recognition

An Unsupervised Method for Uncovering Morphological Chains

2015-03-08 · TACL 2015 1 · Karthik Narasimhan, Regina Barzilay, Tommi Jaakkola

Most state-of-the-art systems today produce morphological analysis based only on orthographic patterns. In contrast, we propose a model for unsupervised morphological analysis that integrates orthographic and semantic vi…

Morphological Analysis

TCL - a Lexicon of Turkish Discourse Connectives

2019-08-01 · WS 2019 8 · Deniz Zeyrek, Kezban Ba{\c{s}}{\i}b{\"u}y{\"u}k

It is known that discourse connectives are the most salient indicators of discourse relations. State-of-the-art parsers being developed to predict explicit discourse connectives exploit annotated discourse corpora but a …

ACE: Automatic Colloquialism, Typographical and Orthographic Errors Detection for Chinese Language

2016-12-01 · COLING 2016 12 · Shichao Dong, Gabriel Pui Cheong Fung, Binyang Li, Baolin Peng 외

We present a system called ACE for Automatic Colloquialism and Errors detection for written Chinese. ACE is based on the combination of N-gram model and rule-base model. Although it focuses on detecting colloquial Canton…

Language ModelingLanguage Modelling

Tokens with Meaning: A Hybrid Tokenization Approach for Turkish

2025-08-19 · M. Ali Bayram, Ali Arda Fincan, Ahmet Semih Gümüş, Sercan Karakaş 외 arxiv

Tokenization shapes how language models perceive morphology and meaning in NLP, yet widely used frequency-driven subword tokenizers (e.g., Byte Pair Encoding and WordPiece) can fragment morphologically rich and agglutina…