Learning Alternative Name Spellings
Name matching is a key component of systems for entity resolution or record linkage. Alternative spellings of the same names are a com- mon occurrence in many applications. We use the largest collection of genealogy person records in the world together with user search query logs to build name matching models. The procedure for building a crowd-sourced training set is outlined together with the presentation of our method. We cast the problem of learning alternative spellings as a machine translation problem at the character level. We use in- formation retrieval evaluation methodology to show that this method substantially outperforms on our data a number of standard well known phonetic and string similarity methods in terms of precision and re- call. Additionally, we rigorously compare the performance of standard methods when compared with each other. Our result can lead to a significant practical impact in entity resolution applications.
Code (0)
등록된 구현이 없습니다.
Tasks
Entity ResolutionMachine TranslationRetrievalTranslationSimilar Papers 제목 키워드 기반
Pair Language Models for Deriving Alternative Pronunciations and Spellings from Pronunciation Dictionaries
Lenient Evaluation of Japanese Speech Recognition: Modeling Naturally Occurring Spelling Inconsistency
Word error rate (WER) and character error rate (CER) are standard metrics in Speech Recognition (ASR), but one problem has always been alternative spellings: If one's system transcribes adviser whereas the ground truth h…
Machine Translationspeech-recognitionSpeech RecognitionvalidMisspellings in Natural Language Processing: A survey
This survey provides an overview of the challenges of misspellings in natural language processing (NLP). While often unintentional, misspellings have become ubiquitous in digital communication, especially with the prolif…
Data AugmentationMachine TranslationSurveytext-classification+2Improving Neural Biasing for Contextual Speech Recognition by Early Context Injection and Text Perturbation
Existing research suggests that automatic speech recognition (ASR) models can benefit from additional contexts (e.g., contact lists, user specified vocabulary). Rare words and named entities can be better recognized with…
Automatic Speech RecognitionAutomatic Speech Recognition (ASR)speech-recognitionSpeech RecognitionMockingBERT: A Method for Retroactively Adding Resilience to NLP Models
Protecting NLP models against misspellings whether accidental or adversarial has been the object of research interest for the past few years. Existing remediations have typically either compromised accuracy or required f…