A Framework for Spelling Correction in Persian Language Using Noisy Channel Model
There are several methods offered for spelling correction in Farsi (Persian) Language. Unfortunately no powerful framework has been implemented because of lack of a large training set in Farsi as an accurate model. A training set consisting of erroneous and related correction string pairs have been obtained from a large number of instances of the books each of which were typed two times in Computer Research Center of Islamic Sciences. We trained our error model using this huge set. In testing part after finding erroneous words in sample text, our program proposes some candidates for related correction. The paper focuses on describing the method of ranking related corrections. This method is customized version of Noisy Channel Spelling Correction for Farsi. This ranking method attempts to find intended correction c from a typo t, that maximizes P(c) P(t | c). In this paper different methods are described and analyzed to obtain a wide overview of the field. Our evaluation results show that Noisy Channel Model using our corpus and training set in this framework works more accurately and improves efficiently in comparison with other methods.
Code (0)
등록된 구현이 없습니다.
Tasks
Spelling CorrectionSimilar Papers 제목 키워드 기반
PERCORE: A Deep Learning-Based Framework for Persian Spelling Correction with Phonetic Analysis
This research introduces a state-of-the-art Persian spelling correction system that seamlessly integrates deep learning techniques with phonetic analysis, significantly enhancing the accuracy and efficiency of natural la…
Spelling CorrectionAutomatic Real-word Error Correction in Persian Text
Automatic spelling correction stands as a pivotal challenge within the ambit of natural language processing (NLP), demanding nuanced solutions. Traditional spelling correction techniques are typically only capable of det…
feature selectionSemantic SimilaritySemantic Textual SimilaritySpelling CorrectionImproving the quality of Persian clinical text with a novel spelling correction system
Background: The accuracy of spelling in Electronic Health Records (EHRs) is a critical factor for efficient clinical care, research, and ensuring patient safety. The Persian language, with its abundant vocabulary and com…
Spelling CorrectionPersian Typographical Error Type Detection Using Deep Neural Networks on Algorithmically-Generated Misspellings
Spelling correction is a remarkable challenge in the field of natural language processing. The objective of spelling correction tasks is to recognize and rectify spelling errors automatically. The development of applicat…
Spelling Correctiontoken-classificationToken ClassificationUnsupervised Context-Sensitive Spelling Correction of English and Dutch Clinical Free-Text with Word and Character N-Gram Embeddings
We present an unsupervised context-sensitive spelling correction method for clinical free-text that uses word and character n-gram embeddings. Our method generates misspelling replacement candidates and ranks them accord…
Spelling Correction