Improving Named Entity Recognition in Spoken Dialog Systems by Context and Speech Pattern Modeling
While named entity recognition (NER) from speech has been around as long as NER from written text has, the accuracy of NER from speech has generally been much lower than that of NER from text. The rise in popularity of spoken dialog systems such as Siri or Alexa highlights the need for more accurate NER from speech because NER is a core component for understanding what users said in dialogs. Deployed spoken dialog systems receive user input in the form of automatic speech recognition (ASR) transcripts, and simply applying NER model trained on written text to ASR transcripts often leads to low accuracy because compared to written text, ASR transcripts lack important cues such as punctuation and capitalization. Besides, errors in ASR transcripts also make NER from speech challenging. We propose two models that exploit dialog context and speech pattern clues to extract named entities more accurately from open-domain dialogs in spoken dialog systems. Our results show the benefit of modeling dialog context and speech patterns in two settings: a standard setting with random partition of data and a more realistic but also more difficult setting where many named entities encountered during deployment are unseen during training.
Code (0)
등록된 구현이 없습니다.
Tasks
Automatic Speech RecognitionAutomatic Speech Recognition (ASR)named-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)NERspeech-recognitionSpeech RecognitionSimilar Papers 제목 키워드 기반
Keyword-Aware ASR Error Augmentation for Robust Dialogue State Tracking
Dialogue State Tracking (DST) is a key part of task-oriented dialogue systems, identifying important information in conversations. However, its accuracy drops significantly in spoken dialogue environments due to named en…
Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Data AugmentationDialogue State Tracking+3"I've Heard of You!": Generate Spoken Named Entity Recognition Data for Unseen Entities
Spoken named entity recognition (NER) aims to identify named entities from speech, playing an important role in speech processing. New named entities appear every day, however, annotating their Spoken NER data is costly.…
Domain AdaptationLanguage ModelingLanguage ModellingLarge Language Model+6SlugNERDS: A Named Entity Recognition Tool for Open Domain Dialogue Systems
In dialogue systems, the tasks of named entity recognition (NER) and named entity linking (NEL) are vital preprocessing steps for understanding user intent, especially in open domain interaction where we cannot rely on d…
Entity Linkingnamed-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)+1Leveraging Cross-Lingual Transfer Learning in Spoken Named Entity Recognition Systems
Recent Named Entity Recognition (NER) advancements have significantly enhanced text classification capabilities. This paper focuses on spoken NER, aimed explicitly at spoken document retrieval, an area not widely studied…
Cross-Lingual Transfernamed-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)+6Leveraging Semantic Web Search and Browse Sessions for Multi-Turn Spoken Dialog Systems
Training statistical dialog models in spoken dialog systems (SDS) requires large amounts of annotated data. The lack of scalable methods for data mining and annotation poses a significant hurdle for state-of-the-art stat…
Entity Extraction using GANRelation Extraction