paper-with-me

홈 › Papers

PERCORE: A Deep Learning-Based Framework for Persian Spelling Correction with Phonetic Analysis

2024-07-20 · Seyed Mohammad Sadegh Dashti, Amid Khatibi Bardsiri, Mehdi Jafari Shahbazzadeh

This research introduces a state-of-the-art Persian spelling correction system that seamlessly integrates deep learning techniques with phonetic analysis, significantly enhancing the accuracy and efficiency of natural language processing (NLP) for Persian. Utilizing a fine-tuned language representation model, our methodology effectively combines deep contextual analysis with phonetic insights, adeptly correcting both non-word and real-word spelling errors. This strategy proves particularly effective in tackling the unique complexities of Persian spelling, including its elaborate morphology and the challenge of homophony. A thorough evaluation on a wide-ranging dataset confirms our system's superior performance compared to existing methods, with impressive F1-Scores of 0.890 for detecting real-word errors and 0.905 for correcting them. Additionally, the system demonstrates a strong capability in non-word error correction, achieving an F1-Score of 0.891. These results illustrate the significant benefits of incorporating phonetic insights into deep learning models for spelling correction. Our contributions not only advance Persian language processing by providing a versatile solution for a variety of NLP applications but also pave the way for future research in the field, emphasizing the critical role of phonetic analysis in developing effective spelling correction system.

📄 PDF Abstract BibTeX arXiv:2407.14789

Code (0)

등록된 구현이 없습니다.

Tasks

Spelling Correction

Similar Papers 제목 키워드 기반

Automatic Real-word Error Correction in Persian Text

2024-07-20 · Seyed Mohammad Sadegh Dashti, Amid Khatibi Bardsiri, Mehdi Jafari Shahbazzadeh

Automatic spelling correction stands as a pivotal challenge within the ambit of natural language processing (NLP), demanding nuanced solutions. Traditional spelling correction techniques are typically only capable of det…

feature selectionSemantic SimilaritySemantic Textual SimilaritySpelling Correction

Spelling Correction using Phonetics in E-commerce Search

2022-05-01 · ECNLP (ACL) 2022 5 · Fan Yang, Alireza Bagheri Garakani, Yifei Teng, Yan Gao 외

In E-commerce search, spelling correction plays an important role to find desired products for customers in processing user-typed search queries. However, resolving phonetic errors is a critical but much overlooked area.…

Spelling Correction

Improving the quality of Persian clinical text with a novel spelling correction system

2024-08-07 · Seyed Mohammad Sadegh Dashti, Seyedeh Fatemeh Dashti

Background: The accuracy of spelling in Electronic Health Records (EHRs) is a critical factor for efficient clinical care, research, and ensuring patient safety. The Persian language, with its abundant vocabulary and com…

Spelling Correction

A Framework for Spelling Correction in Persian Language Using Noisy Channel Model

2012-05-01 · LREC 2012 5 · Mohammad Hoseyn Sheykholeslam, Behrouz Minaei-Bidgoli, Hossein Juzi

There are several methods offered for spelling correction in Farsi (Persian) Language. Unfortunately no powerful framework has been implemented because of lack of a large training set in Farsi as an accurate model. A tra…

Spelling Correction

Persian Typographical Error Type Detection Using Deep Neural Networks on Algorithmically-Generated Misspellings

2023-05-19 · Mohammad Dehghani, Heshaam Faili

Spelling correction is a remarkable challenge in the field of natural language processing. The objective of spelling correction tasks is to recognize and rectify spelling errors automatically. The development of applicat…

Spelling Correctiontoken-classificationToken Classification