Automatic Spelling Correction for Resource-Scarce Languages using Deep Learning
Spelling correction is a well-known task in Natural Language Processing (NLP). Automatic spelling correction is important for many NLP applications like web search engines, text summarization, sentiment analysis etc. Most approaches use parallel data of noisy and correct word mappings from different sources as training data for automatic spelling correction. Indic languages are resource-scarce and do not have such parallel data due to low volume of queries and non-existence of such prior implementations. In this paper, we show how to build an automatic spelling corrector for resource-scarce languages. We propose a sequence-to-sequence deep learning model which trains end-to-end. We perform experiments on synthetic datasets created for Indic languages, Hindi and Telugu, by incorporating the spelling mistakes committed at character level. A comparative evaluation shows that our model is competitive with the existing spell checking and correction techniques for Indic languages.
Code (0)
등록된 구현이 없습니다.
Tasks
Deep LearningMachine TranslationSentiment AnalysisSpelling CorrectionText SummarizationSimilar Papers 제목 키워드 기반
Spelling Correction with Denoising Transformer
We present a novel method of performing spelling correction on short input strings, such as search queries or individual words. At its core lies a procedure for generating artificial typos which closely follow the error …
Bangla Spelling Error CorrectionDenoisingSpelling CorrectionDPCSpell: A Transformer-based Detector-Purificator-Corrector Framework for Spelling Error Correction of Bangla and Resource Scarce Indic Languages
Spelling error correction is the task of identifying and rectifying misspelled words in texts. It is a potential and active research topic in Natural Language Processing because of numerous applications in human language…
Bangla Spelling Error CorrectionDenoisingBeqi: Revitalize the Senegalese Wolof Language with a Robust Spelling Corrector
The progress of Natural Language Processing (NLP), although fast in recent years, is not at the same pace for all languages. African languages in particular are still behind and lack automatic processing tools. Some of t…
Spelling CorrectionComparison of Interactive Knowledge Base Spelling Correction Models for Low-Resource Languages
Spelling normalization for low resource languages is a challenging task because the patterns are hard to predict and large corpora are usually required to collect enough examples. This work shows a comparison of a neural…
Spelling CorrectionGrammatical Error Correction for Low-Resource Languages: The Case of Zarma
Grammatical error correction (GEC) is important for improving written materials for low-resource languages like Zarma -- spoken by over 5 million people in West Africa. Yet it remains a challenging problem. This study co…
Grammatical Error CorrectionMachine Translation