Correcting Real-Word Spelling Errors: A New Hybrid Approach
Spelling correction is one of the main tasks in the field of Natural Language Processing. Contrary to common spelling errors, real-word errors cannot be detected by conventional spelling correction methods. The real-word correction model proposed by Mays, Damerau and Mercer showed a great performance in different evaluations. In this research, however, a new hybrid approach is proposed which relies on statistical and syntactic knowledge to detect and correct real-word errors. In this model, Constraint Grammar (CG) is used to discriminate among sets of correction candidates in the search space. Mays, Damerau and Mercer's trigram approach is manipulated to estimate the probability of syntactically well-formed correction candidates. The approach proposed here is tested on the Wall Street Journal corpus. The model can prove to be more practical than some other models, such as WordNet-based method of Hirst and Budanitsky and fixed windows size method of Wilcox-O'Hearn and Hirst.
Code (0)
등록된 구현이 없습니다.
Tasks
Spelling CorrectionSimilar Papers 제목 키워드 기반
PERCORE: A Deep Learning-Based Framework for Persian Spelling Correction with Phonetic Analysis
This research introduces a state-of-the-art Persian spelling correction system that seamlessly integrates deep learning techniques with phonetic analysis, significantly enhancing the accuracy and efficiency of natural la…
Spelling CorrectionA Nested Attention Neural Hybrid Model for Grammatical Error Correction
Grammatical error correction (GEC) systems strive to correct both global errors in word order and usage, and local errors in spelling and inflection. Further developing upon recent work on neural machine translation, we …
Grammatical Error CorrectionMachine TranslationTranslationAutomatic Real-word Error Correction in Persian Text
Automatic spelling correction stands as a pivotal challenge within the ambit of natural language processing (NLP), demanding nuanced solutions. Traditional spelling correction techniques are typically only capable of det…
feature selectionSemantic SimilaritySemantic Textual SimilaritySpelling CorrectionReal-Word Error Correction with Trigrams: Correcting Multiple Errors in a Sentence
Spelling correction is a fundamental task in Text Mining. In this study, we assess the real-word error correction model proposed by Mays, Damerau and Mercer and describe several drawbacks of the model. We propose a new v…
SentenceSpelling CorrectionA Comprehensive Approach to Misspelling Correction with BERT and Levenshtein Distance
Writing, as an omnipresent form of human communication, permeates nearly every aspect of contemporary life. Consequently, inaccuracies or errors in written communication can lead to profound consequences, ranging from fi…
Language ModelingLanguage Modelling