BSpell: A CNN-Blended BERT Based Bangla Spell Checker
Bangla typing is mostly performed using English keyboard and can be highly erroneous due to the presence of compound and similarly pronounced letters. Spelling correction of a misspelled word requires understanding of word typing pattern as well as the context of the word usage. A specialized BERT model named BSpell has been proposed in this paper targeted towards word for word correction in sentence level. BSpell contains an end-to-end trainable CNN sub-model named SemanticNet along with specialized auxiliary loss. This allows BSpell to specialize in highly inflected Bangla vocabulary in the presence of spelling errors. Furthermore, a hybrid pretraining scheme has been proposed for BSpell that combines word level and character level masking. Comparison on two Bangla and one Hindi spelling correction dataset shows the superiority of our proposed approach. BSpell is available as a Bangla spell checking tool via GitHub: https://github.com/Hasiburshanto/Bangla-Spell-Checker
Code (1)
Tasks
SentenceSpelling CorrectionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Bangla Word Clustering Based on Tri-gram, 4-gram and 5-gram Language Model
In this paper, we describe a research method that generates Bangla word clusters on the basis of relating to meaning in language and contextual similarity. The importance of word clustering is in parts of speech (POS) ta…
ClusteringLanguage ModelingLanguage ModellingPOS+5Bangla Parts-of-Speech Tagging using Bangla Stemmer and Rule based Analyzer
Parts-of-Speech (POS) tagging plays vital roles in the field of Natural Language Processing (NLP), such as - machine translation, spell checker, information retrieval, speech processing, emotion analysis and so on. Bangl…
Emotion RecognitionInformation RetrievalMachine TranslationPart-Of-Speech Tagging+4Bangla Grammatical Error Detection Leveraging Transformer-based Token Classification
Bangla is the seventh most spoken language by a total number of speakers in the world, and yet the development of an automated grammar checker in this language is an understudied problem. Bangla grammatical error detecti…
Grammatical Error Detectiontoken-classificationToken ClassificationFASPell: A Fast, Adaptable, Simple, Powerful Chinese Spell Checker Based On DAE-Decoder Paradigm
We propose a Chinese spell checker {--} FASPell based on a new paradigm which consists of a denoising autoencoder (DAE) and a decoder. In comparison with previous state-of-the-art models, the new paradigm allows our spel…
Chinese Spell CheckingDecoderDenoisingLanguage Modeling+1uChecker: Masked Pretrained Language Models as Unsupervised Chinese Spelling Checkers
The task of Chinese Spelling Check (CSC) is aiming to detect and correct spelling errors that can be found in the text. While manually annotating a high-quality dataset is expensive and time-consuming, thus the scale of …
Language ModelingLanguage ModellingSentence