paper-with-me

Papers

Contextual Multilingual Spellchecker for User Queries

2023-05-01 · Sanat Sharma, Josep Valls-Vargas, Tracy Holloway King, Francois Guerin, Chirag Arora

Spellchecking is one of the most fundamental and widely used search features. Correcting incorrectly spelled user queries not only enhances the user experience but is expected by the user. However, most widely available spellchecking solutions are either lower accuracy than state-of-the-art solutions or too slow to be used for search use cases where latency is a key requirement. Furthermore, most innovative recent architectures focus on English and are not trained in a multilingual fashion and are trained for spell correction in longer text, which is a different paradigm from spell correction for user queries, where context is sparse (most queries are 1-2 words long). Finally, since most enterprises have unique vocabularies such as product names, off-the-shelf spelling solutions fall short of users' needs. In this work, we build a multilingual spellchecker that is extremely fast and scalable and that adapts its vocabulary and hence speller output based on a specific product's needs. Furthermore, our speller out-performs general purpose spellers by a wide margin on in-domain datasets. Our multilingual speller is used in search in Adobe products, powering autocomplete in various applications.

📄 PDF Abstract BibTeX arXiv:2305.01082

Code (1)

wolfgarbe/symspell 공식 구현

Similar Papers 제목 키워드 기반

KidSpell: A Child-Oriented, Rule-Based, Phonetic Spellchecker

2020-05-01 · LREC 2020 5 · Brody Downs, Oghenemaro Anuyah, Aprajita Shukla, Jerry Alan Fails 외

For help with their spelling errors, children often turn to spellcheckers integrated in software applications like word processors and search engines. However, existing spellcheckers are usually tuned to the needs of tra…

SpellMapper: A non-autoregressive neural spellchecker for ASR customization with candidate retrieval based on n-gram mappings

2023-06-04 · Alexandra Antonova, Evelina Bakhturina, Boris Ginsburg

Contextual spelling correction models are an alternative to shallow fusion to improve automatic speech recognition (ASR) quality given user vocabulary. To deal with large user vocabularies, most of these models include c…

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Retrievalspeech-recognition+2

UM6P-CS at SemEval-2022 Task 11: Enhancing Multilingual and Code-Mixed Complex Named Entity Recognition via Pseudo Labels using Multilingual Transformer

2022-04-28 · SemEval (NAACL) 2022 7 · Abdellah El Mekki, Abdelkader El Mahdaouy, Mohammed Akallouch, Ismail Berrada 외

Building real-world complex Named Entity Recognition (NER) systems is a challenging task. This is due to the complexity and ambiguity of named entities that appear in various contexts such as short input sentences, emerg…

named-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)NER+2

Auto Spell Suggestion for High Quality Speech Synthesis in Hindi

2014-02-15 · Shikha Kabra, Ritika Agarwal

The goal of Text-to-Speech (TTS) synthesis in a particular language is to convert arbitrary input text to intelligible and natural sounding speech. However, for a particular language like Hindi, which is a highly confusi…

Speech Synthesistext-to-speechText to SpeechVocal Bursts Intensity Prediction

The Influence of Regional Pronunciation Variation on Children’s Spelling and the Potential Benefits of Accent Adapted Spellcheckers

2021-11-01 · CoNLL (EMNLP) 2021 11 · Emma O’Neill, Joe Kenny, Anthony Ventresque, Julie Carson-Berndsen

A child who is unfamiliar with the correct spelling of a word often employs a “sound it out” approach: breaking the word down into its constituent sounds and then choosing letters to represent the identified sounds. This…

Spelling Correction