paper-with-me

Papers

Neural spell-checker: Beyond words with synthetic data generation

2024-10-30 · Matej Klemen, Martin Božič, Špela Arhar Holdt, Marko Robnik-Šikonja

Spell-checkers are valuable tools that enhance communication by identifying misspelled words in written texts. Recent improvements in deep learning, and in particular in large language models, have opened new opportunities to improve traditional spell-checkers with new functionalities that not only assess spelling correctness but also the suitability of a word for a given context. In our work, we present and compare two new spell-checkers and evaluate them on synthetic, learner, and more general-domain Slovene datasets. The first spell-checker is a traditional, fast, word-based approach, based on a morphological lexicon with a significantly larger word list compared to existing spell-checkers. The second approach uses a language model trained on a large corpus with synthetically inserted errors. We present the training data construction strategies, which turn out to be a crucial component of neural spell-checkers. Further, the proposed neural model significantly outperforms all existing spell-checkers for Slovene in both precision and recall.

📄 PDF Abstract BibTeX arXiv:2410.23514

Code (1)

matejklemen/slonspell 공식 구현 pytorch

Tasks

Language ModelingLanguage ModellingSynthetic Data Generation

Similar Papers 제목 키워드 기반

SinSpell: A Comprehensive Spelling Checker for Sinhala

2021-07-07 · Upuli Liyanapathirana, Kaumini Gunasinghe, Gihan Dias

We have built SinSpell, a comprehensive spelling checker for the Sinhala language which is spoken by over 16 million people, mainly in Sri Lanka. However, until recently, Sinhala had no spelling checker with acceptable c…

valid

Kannada Spell Checker with Sandhi Splitter

2016-11-25 · A N Akshatha, Chandana G Upadhyaya, Rajashekara S Murthy

Spelling errors are introduced in text either during typing, or when the user does not know the correct phoneme or grapheme. If a language contains complex words like sandhi where two or more morphemes join based on some…

Machine Translation

KidSpell: A Child-Oriented, Rule-Based, Phonetic Spellchecker

2020-05-01 · LREC 2020 5 · Brody Downs, Oghenemaro Anuyah, Aprajita Shukla, Jerry Alan Fails 외

For help with their spelling errors, children often turn to spellcheckers integrated in software applications like word processors and search engines. However, existing spellcheckers are usually tuned to the needs of tra…

Automatic Spell Checker and Correction for Under-represented Spoken Languages: Case Study on Wolof

2023-05-22 · Thierno Ibrahima Cissé, Fatiha Sadat

This paper presents a spell checker and correction tool specifically designed for Wolof, an under-represented spoken language in Africa. The proposed spell checker leverages a combination of a trie data structure, dynami…

A Language Model for Spell Checking of Educational Texts in Kurdish (Sorani)

2022-06-01 · SIGUL (LREC) 2022 6 · Roshna Abdulrahman, Hossein Hassani

Spell checkers are an integrated feature of most software applications handling text inputs. When we write an email or compile a report on a desktop or a smartphone editor, a spell checker could be activated that assists…

Language ModelingLanguage Modelling